C
Posted 9 hours ago
Principal Software Engineer
Capgemini
Requirements
4+ years Databricks experience, Databricks medallion architecture, PySpark/Python expertise, SQL development skills, Cloud platform experience (Azure, AWS, or GCP), Delta Lake production deployment, Orchestration tools like Airflow, Unity Catalog knowledge
Skills
DatabricksPySparkPythonSQLAzureAWSAirflow
About the role
Responsibilities
- Design and deliver end-to-end data engineering solutions using Databricks medallion architecture
- Lead large teams of engineers and developers in the deployment of Databricks solutions
- Apply scientific methods to analyze and solve complex software engineering problems
- Drive technical decisions and innovation throughout the software development lifecycle
- Manage senior client stakeholders and develop long-term technical partnerships
- Oversee the development, maintenance, and optimization of software applications
Requirements
- At least four years of experience designing and delivering data engineering solutions with Databricks
- Expert-level hands-on development knowledge in PySpark and Python
- Expert-level hands-on SQL development skills
- Hands-on experience with at least two cloud platforms (Azure, AWS, or Google Cloud)
- Proven experience deploying Delta Lake solutions into production environments
- Strong knowledge of Unity Catalog and orchestration tools like Airflow
- Solid grasp of database engineering and design principles
Preferred Qualifications
- Experience with ETL tools such as Informatica, Talend, or Matillion
- Familiarity with CI/CD methods
- Expertise in Delta Sharing, Marketplace, and Databricks Apps
- Working knowledge of Databricks Genie, AI/BI, and data visualization capabilities
Benefits
- Paid time off including vacation, company holidays, personal days, and sick leave
- Medical, dental, and vision coverage
- Retirement savings plans (e.g., 401(k) in the U.S.)
- Life and disability insurance
- Employee assistance programs
About the Company
Capgemini is a global business and technology transformation partner, helping organizations accelerate their transition to a digital and sustainable world. With over 340,000 team members in more than 50 countries, we leverage expertise in AI, cloud, and data to deliver end-to-end services that address the entire breadth of our clients' business needs.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freePrincipal Software Engineer
Capgemini · Dallas
