AWS Data Engineer - Senior

Responsibilities

• Develop, optimize, and deploy scalable ETL/ELT pipelines using PySpark, SQL, and AWS services
• Build and manage data lakehouse solutions leveraging AWS S3, Glue, Iceberg, and other AWS-native components
• Migrate on-premises ETL workloads to modern AWS-based architectures with a focus on performance and cost efficiency
• Implement metadata-driven ingestion frameworks and medallion/layered architecture (Bronze/Silver/Gold)
• Work with orchestration frameworks such as Astronomer (Airflow) or AWS Step Functions
• Design and optimize Spark-based data processing jobs for high throughput
• Collaborate with data analysts, data scientists, and BI engineers for seamless data delivery
• Perform code reviews, troubleshoot issues, and ensure end-to-end data quality

Requirements

• 4+ years of total IT experience with at least 2+ years in AWS-based data engineering
• Strong hands-on experience with PySpark, SQL, and Python
• Proficiency with Databricks (PySpark, Delta Lake, Unity Catalog)
• Experience with AWS services including S3, Glue, Lambda, and Step Functions
• Knowledge of Iceberg table format and orchestration tools like Airflow
• Understanding of data warehousing concepts, star/snowflake schemas, and dimensional modeling
• Bachelor’s or Master’s degree in Computer Science, IT, or a related field
• Experience with CI/CD and version control (GitHub, Azure DevOps, or Jenkins)

Preferred Qualifications

• Experience working with Databricks Delta Live Tables
• Client-facing and stakeholder management experience
• Experience working in large-scale, multi-environment data platforms

Benefits

• Opportunities to work on diverse, industry-leading projects
• Coaching, learning programs, and personalized growth and development plans
• Exposure to a collaborative, interdisciplinary work culture
• Flexibility to manage your work in a way that suits you best

About the Company

EY is a global leader in assurance, consulting, law, strategy, tax, and transactions. Our Data and Analytics team helps clients solve complex business challenges by modernizing data ecosystems and enabling scalable analytics platforms across various industries.