Senior Data Engineer

Responsibilities

• Lead the design, development, and optimization of scalable data pipelines and data products for analytics, operational, and AI-driven use cases.
• Influence architectural decisions across the data platform, including ingestion, transformation, orchestration, storage, and governance.
• Build and maintain robust batch and near-real-time pipelines using Databricks, Spark, and Python.
• Drive engineering best practices including modular design, observability, testing, CI/CD, and version control.
• Mentor and guide other data engineers through code reviews, technical design discussions, and standards adoption.
• Optimize large-scale data workloads for performance, reliability, scalability, and cost efficiency.
• Collaborate with cross-functional teams to enable data consumption across analytics, operational systems, and marketing technology platforms.

Requirements

• Bachelor's degree in Computer Science, Engineering, Mathematics, Information Systems, or a related technical field.
• 7+ years of experience in data engineering, software engineering, or related technical roles.
• Strong hands-on experience with Databricks in a production environment.
• Proficiency in Python and Apache Spark for large-scale data processing.
• Experience with enterprise ETL/orchestration tools such as Azure Data Factory (ADF) or Airflow.
• Proven experience building and supporting data pipelines for large, complex, high-volume datasets.
• Strong knowledge of modern data architecture concepts including lakehouse, data lake, and warehouse patterns.
• Experience with SQL, relational and analytical data modeling, and schema design.

Preferred Qualifications

• Experience building or supporting agentic AI or AI/ML-enabled data workflows.
• Familiarity with LLM-enablement patterns and vector-ready data preparation.
• Experience in the MarTech ecosystem, including customer data platforms and personalization platforms.
• Experience with cloud-native platform services in Azure.
• Experience with streaming/event-based architectures and APIs.
• Familiarity with DevOps/DataOps practices including infrastructure-as-code and automated testing.

About the Company

At Giant Eagle, we believe in nourishing life’s moments, big and small, because they matter. We strive to lead the way in quality, service, and everyday value. Most importantly, the compassion, care, and respect our Team Members show to each other and in our communities is what truly sets us apart.