Data Engineer

Responsibilities

• Develop, maintain, and enhance batch and near-real-time data pipelines using Databricks, Spark, Python, and ADF or Airflow.
• Build data workflows to ingest, transform, validate, and publish large-scale datasets for analytics and downstream consumption.
• Optimize data processing jobs for performance, reliability, scalability, and cost efficiency.
• Support the design and implementation of data models, curated datasets, and transformation logic.
• Troubleshoot data issues across ingestion, transformation, orchestration, and delivery layers.
• Ensure data quality and observability through validation, monitoring, logging, and testing practices.
• Collaborate with product managers, analysts, and engineering teams to translate requirements into effective data solutions.
• Enable AI and automation use cases by preparing reliable, scalable, and high-quality data assets.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Mathematics, Information Systems, or a related technical field.
• 3+ years of experience in data engineering, software engineering, or related technical roles.
• Hands-on experience with Databricks in a production or enterprise data environment.
• Strong programming skills in Python and experience using Apache Spark for large-scale data processing.
• Experience with ETL and orchestration tools such as Azure Data Factory (ADF), Airflow, or equivalent platforms.
• Strong SQL skills and experience with data transformation, data modeling, and schema design.
• Experience building and supporting pipelines for large and complex datasets.
• Familiarity with modern cloud data platforms and lakehouse/warehouse concepts.

Preferred Qualifications

• Experience working with agentic AI or AI-enabled data workflows.
• Familiarity with the MarTech ecosystem.

Benefits

• Health, vision, and dental insurance.
• Personal/sick paid time.
• 401(k) retirement savings plan.
• Bonus potential.
• Paid bereavement, vacation, and holidays.

About the Company

At Giant Eagle, we believe in nourishing life’s moments, big and small, because they matter. We strive to lead the way in quality, service, and everyday value. Most importantly, the compassion, care, and respect our Team Members show to each other and in our communities is what truly sets us apart.