Sr Data Engineer

Responsibilities

• Design, develop, and maintain scalable data solutions and end-to-end data pipelines for large-scale datasets.
• Implement ETL/ELT processes to ensure data quality, reliability, and seamless migration across systems.
• Leverage Databricks, PySpark, and SQL to ingest, transform, and process both structured and unstructured data.
• Optimize data pipeline performance through Spark job tuning, caching, partitioning, and indexing.
• Collaborate with Data Architects, Data Scientists, and cross-functional global teams to meet complex business requirements.
• Build automated workflows for data ingestion and deployment using Databricks Jobs and other orchestration tools.
• Maintain data models, dictionaries, and documentation while adhering to data security and privacy measures.

Requirements

• Bachelor’s or Master’s degree in Computer Science, IT, or a related field.
• 8 to 13 years of professional experience in data engineering or a related technical role.
• Hands-on experience with big data technologies, specifically Databricks and Apache Spark (PySpark, SparkSQL).
• Proficiency in SQL and advanced data analysis techniques.
• Strong understanding of ETL/ELT processes and data integration solutions.
• Experience working with cloud platforms, preferably AWS.
• Proven ability to work with large, complex datasets and solve intricate data-related challenges.

Preferred Qualifications

• Professional certification as a Data Engineer (Databricks or cloud-based environments).
• Experience with workflow orchestration tools such as Apache Airflow.
• Knowledge of data protection regulations and compliance requirements like GDPR or CCPA.
• Familiarity with Python/R, SageMaker, and various machine learning model development packages.
• Experience with multi-source integration involving APIs and cloud storage platforms.

About the Company

Amgen is a leading biotechnology pioneer committed to unlocking the potential of biology for patients suffering from serious illnesses. By discovering, developing, and manufacturing innovative human therapeutics, Amgen leverages advanced genetics and biologics expertise to improve health outcomes and dramatically improve people's lives worldwide.