AWS Data Engineer Manager

Responsibilities

• Architect, design, and oversee scalable ETL/ELT pipelines using PySpark, SQL, Python, and AWS data services
• Lead the implementation of data lakehouse solutions using AWS S3, Glue, Iceberg, and other cloud-native components
• Drive the migration of on-premises data workloads to AWS, ensuring performance, reliability, and cost optimization
• Lead teams in building and operationalizing data pipelines using orchestration tools like Airflow (Astronomer) or AWS Step Functions
• Mentor and guide data engineers in technical delivery and facilitate Agile/Scrum delivery across multi-functional teams
• Collaborate with BI, data science, and product teams to translate business requirements into scalable technical solutions

Requirements

• 9+ years of overall IT experience, including 5+ years in AWS-based data engineering
• 2+ years of experience in a leadership or managerial capacity
• Bachelor’s or Master’s degree in Computer Science, IT, or a related field
• Advanced hands-on expertise in PySpark, SQL, and Python
• Deep knowledge of AWS services including S3, Glue, Lambda, and Step Functions
• Strong understanding of ETL/ELT design, data lake/lakehouse architectures, and Apache Iceberg
• Experience with orchestration tools such as Airflow or Astronomer
• Practical experience with CI/CD frameworks (e.g., GitHub, Azure DevOps, or Jenkins)

Preferred Qualifications

• Experience with Databricks (Delta Lake, PySpark notebooks, Unity Catalog)
• Familiarity with modern governance frameworks and MLOps/DevOps integrations
• Prior client-facing experience with the ability to influence senior stakeholders

Benefits

• Opportunities to work on diverse, industry-leading, and high-impact data programs
• Access to continuous learning, coaching, and tailored career development
• A collaborative, inclusive, and global work environment
• Flexibility to manage work in a way that suits you best

About the Company

EY is a global leader in assurance, consulting, tax, and transactions. We help create long-term value for clients, people, and society by building a better working world through the power of data and technology.