Senior Data Engineer

Responsibilities

• Lead and mentor a team of data engineers to solve complex problems within the R&D division.
• Design, build, and optimize large-scale data pipelines and workflows using Databricks (Spark, Delta Lake).
• Oversee data extraction, validation, and transformation techniques to ensure high-quality data ingestion.
• Implement performance monitoring, automated recovery mechanisms, and self-healing solutions for data pipelines.
• Drive data governance strategies, ensuring compliance with security policies and data accessibility best practices.
• Collaborate with Data Architects, Data Scientists, and business leaders to align data architecture with business objectives.
• Manage sprint backlogs and drive Agile/SAFe methodologies to enhance team velocity and project delivery.
• Utilize CI/CD pipelines and DevOps practices to support the release process and maintain software quality.

Requirements

• Master’s or Bachelor’s degree in Computer Science, IT, or a related field.
• 8 to 13 years of experience in data engineering or related roles.
• AWS Certified Data Engineer certification (Required).
• Proven experience managing and leading a team of data engineers.
• Proficiency in Python, PySpark, and SQL.
• Hands-on experience with cloud platforms (AWS preferred) and architecting scalable data solutions.
• Extensive experience with Apache Spark and Apache Airflow.
• Strong understanding of dimensional data modeling and ETL processes.
• Experience with version control (Git), CI/CD (Jenkins, Maven), and DevOps practices.

Preferred Qualifications

• Databricks Certification.
• Knowledge of Medallion Architecture.
• Experience with other cloud platforms such as GCP or Azure.
• Familiarity with data protection regulations like GDPR or CCPA.
• Experience with infrastructure-as-code and automated testing.

About the Company

Amgen is a leading biotechnology pioneer dedicated to unlocking the potential of biology for patients suffering from serious illnesses. By leveraging advanced human genetics and biologics manufacturing expertise, Amgen discovers and delivers innovative human therapeutics to improve health outcomes and lives worldwide.