AWS Data Engineer

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark
• Build and operate Delta Live Tables pipelines in both streaming and triggered modes
• Select and configure appropriate Databricks compute for various workload types
• Implement and maintain data governance using Unity Catalog across Databricks workspaces
• Diagnose, analyze, and optimize slow SQL queries on large Delta tables
• Define, package, and deploy Databricks resources using Databricks Asset Bundles
• Collaborate with data engineers, analytics teams, and platform stakeholders to ensure high-performance data solutions

Requirements

• Strong experience with AWS Databricks
• Proven proficiency in building scalable data pipelines using Python and PySpark
• Hands-on experience designing and operating Delta Live Tables pipelines
• Experience using Databricks Asset Bundles for infrastructure and deployment as code
• Experience working with Unity Catalog to centralize data governance
• Solid understanding of data modeling and data quality concepts
• Practical experience using AI-powered assistants (e.g., Claude Code, GitHub Copilot, Cursor) to improve productivity
• Must reside in the European Union and possess a valid EU work permit

Preferred Qualifications

• Familiarity with CI/CD practices for data platforms
• Experience with streaming data architectures and data platform cost optimization
• Knowledge of the wider AWS data ecosystem services
• Experience applying GenAI within the SDLC through defined workflows or prompt patterns
• Experience mentoring or supporting other data engineers

About the Company

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions. We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products.