Data Engineer

Responsibilities

• Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL.
• Build efficient data pipelines to migrate and deploy complex data across systems within the manufacturing domain.
• Implement solutions for unified data access, governance, and interoperability across hybrid cloud environments.
• Ingest and transform structured and unstructured data from various sources including databases, APIs, logs, and event streams.
• Ensure data integrity and accuracy through rigorous quality checks and monitoring.
• Collaborate with cross-functional teams in a Scaled Agile (SAFe) environment to translate business requirements into technical solutions.
• Automate tasks and develop reusable frameworks to enhance data processing efficiency.

Requirements

• 5-8 years of experience in Computer Science, IT, or a related field.
• Bachelor's or Master's degree in a relevant discipline.
• Hands-on experience with Databricks, PySpark, SparkSQL, Apache Spark, and AWS.
• Proficiency in Python and SQL.
• Experience with Scaled Agile (SAFe) methodologies and DevOps practices.
• Experience with streaming technologies such as Apache Kafka or Debezium.
• Strong problem-solving, analytical, and communication skills.

Preferred Qualifications

• AWS Certified Data Engineer, Databricks Certificate, or SAFe certification.
• Experience in the biotechnology or pharmaceutical industry.
• Knowledge of manufacturing data sources like SCADA or Data Historians.
• Experience with AI-assisted code development tools (e.g., GitHub Copilot).
• Experience writing APIs and working with vector databases for LLMs.
• Proficiency in CI/CD tools like Jenkins and Maven.

About the Company

Amgen is a leading biotechnology company dedicated to unlocking the potential of biology to serve patients suffering from serious illnesses. By leveraging advanced human genetics and biologics manufacturing expertise, Amgen discovers and delivers innovative human therapeutics to improve health outcomes worldwide.