Senior Data Engineer

Responsibilities

• Design and implement scalable, reliable data architectures on Google Cloud Platform (GCP)
• Define data models, warehouse structures, and data lake strategies using BigQuery and GCS
• Build and maintain end-to-end ETL/ELT pipelines using GCP services including WorkFlow, Dataproc, Cloud Run, and Cloud Composer
• Develop both batch and real-time data processing pipelines
• Implement CI/CD pipelines for data workflows using Cloud Build and Terraform
• Design and execute data migration strategies from on-prem or legacy systems to GCP
• Ensure adherence to data governance, security, and compliance policies
• Optimize BigQuery queries, storage costs, and Spark/PySpark job performance
• Collaborate with Data Scientists, Data Analysts, and Product teams to translate business requirements into technical solutions

Requirements

• Extensive experience with GCP architecture design, BigQuery, and GCS
• Strong proficiency in Python, SQL, and PySpark
• Proven track record in ETL/ELT pipeline development
• Experience with CI/CD implementation using Terraform
• Expertise in data migration strategies and handling large-scale data ingestion
• Strong understanding of data validation, monitoring, and quality checks

Preferred Qualifications

• Exposure to AI/ML data pipelines using Vertex AI or ADK
• Experience with streaming frameworks such as Kafka or Pub/Sub
• Deep understanding of modern data warehousing concepts

About the Company

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence. We deliver a rich portfolio of high-performance DRAM, NAND, and NOR memory and storage products that fuel the data economy and enable advances in artificial intelligence and 5G applications.