Data Engineer

Responsibilities

• Design, build, and operate scalable, secure, and analytics-ready data pipelines and models across GCP BigQuery and AWS.
• Orchestrate data workflows and automations using Apache Airflow.
• Implement DBT Cloud transformations, including testing frameworks and environment governance.
• Manage robust CI/CD and Infrastructure as Code (IaC) deployments using tools like Terraform, CloudFormation, GitHub Actions, or Bitbucket.
• Optimize performance across data pipelines, SQL queries, BigQuery, and AWS data services.
• Provide high-quality technical documentation, production support, and incident response.
• Collaborate with cross-functional stakeholders in analytics, product, and platform engineering.

Requirements

• 8 or more years of experience in data engineering or equivalent technical roles.
• Strong proficiency in both GCP (BigQuery, Cloud Storage) and AWS (Lambda, S3, RDS, Redshift).
• Advanced expertise in SQL (analytical and window functions) and Python.
• Hands-on experience with dbt Cloud (models, SCDs, macros, and release management).
• Proven experience with Airflow workflow design, including idempotency and monitoring.
• Strong data modelling expertise involving facts, dimensions, and SCD patterns.
• Experience with Infrastructure as Code (Terraform or CloudFormation) and CI/CD pipelines.
• Solid understanding of cloud security best practices and IAM least-privilege principles.

Preferred Qualifications

• Experience with Dataplex or Collibra integration.
• Familiarity with monitoring and observability tools like Grafana or Splunk.
• Experience with Power BI data preparation.
• Background working with financial services data and regulated environments.

About the Company

Endava combines world-class engineering, industry expertise, and a people-centric mindset to partner with leading brands. We consult and create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses globally.