Senior Data Engineer

Responsibilities

• Design, develop, and maintain scalable data solutions and ETL/ELT pipelines for data generation and processing
• Build and manage end-to-end data pipelines leveraging Databricks, PySpark, and SQL to ingest and transform large-scale datasets
• Implement automated workflows for data ingestion and deployment using Databricks Jobs and notebooks
• Optimize data performance through Spark job tuning, caching, partitioning, and indexing
• Collaborate with Data Architects, Data Scientists, and cross-functional teams to meet global business requirements
• Develop and maintain data models, data dictionaries, and documentation to ensure data accuracy and consistency
• Implement data security and privacy measures to protect sensitive information
• Identify and resolve complex data-related challenges and explore new tools to improve platform performance

Requirements

• Bachelor’s or Master’s degree in Computer Science, IT, or a related field
• 8 to 13 years of professional experience in data engineering or a related role
• Hands-on experience with big data technologies including Databricks and Apache Spark (PySpark, SparkSQL)
• Proficiency in SQL and data analysis tools
• Strong experience with ETL/ELT processes and workflow orchestration
• Knowledge of cloud platforms, specifically AWS
• Excellent problem-solving skills and ability to work with large, complex datasets

Preferred Qualifications

• Professional certification as a Data Engineer (Databricks or cloud environments)
• Experience with workflow orchestration tools like Apache Airflow
• Knowledge of data protection regulations such as GDPR or CCPA
• Experience with Python/R and machine learning model development environments like SageMaker
• Familiarity with data warehousing and multi-source integration involving APIs and cloud storage

About the Company

Amgen harnesses the best of biology and technology to fight the world’s toughest diseases. As a biotechnology pioneer, we discover, develop, and deliver innovative medicines to help millions of patients worldwide. We use advanced human genetics and cutting-edge technology to push the boundaries of what is known in medicine.