Associate Data Engineer

Responsibilities

• Build and operate large-scale healthcare data pipelines across batch workflows and metadata-driven ingestion
• Own end-to-end engineering from source ingestion to conformed data products, focusing on reliability and data quality
• Design and maintain PySpark and SQL pipelines in Databricks for various data layers
• Build and support Airflow DAGs for scheduling, dependencies, and production operations
• Implement metadata-driven frameworks for ingestion, transformation, and rule-based processing
• Develop robust data quality controls, failure handling, and alerting workflows
• Integrate multi-source data from files, APIs, cloud storage, and relational systems into governed Delta/Spark tables
• Optimize pipeline performance using partitioning, parallelization, and query tuning

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field
• 2-6 years of professional experience in data engineering
• Advanced proficiency in Python, PySpark, and SQL (including window functions and complex joins)
• Hands-on experience with Databricks and Airflow in enterprise environments
• Experience with cloud data platforms (AWS), object storage, and secure secret handling
• Strong understanding of ETL orchestration, dependency management, and SLA-driven delivery
• Experience with data quality engineering and troubleshooting in regulated data contexts

About the Company

Amgen is a biotechnology pioneer committed to unlocking the potential of biology for patients suffering from serious illnesses. By discovering, developing, and delivering innovative human therapeutics, Amgen leverages advanced human genetics to understand the complexities of disease and improve health outcomes worldwide.