Senior Data Engineer at Deriv.com - ScoutJobs - The AI-curated global job board
Skip to content
Deriv.com
Posted 14 hours ago

Senior Data Engineer

Deriv.comSenior Data Engineer

Requirements

6+ years in data engineering, Proficiency in GCP and BigQuery, Experience with Airflow, Expertise in Python and SQL, Knowledge of dbt or Dataform, Experience with Kafka or Pub/Sub, Data modelling (Kimball, Data Vault, or Medallion)

Skills

PythonSQLGCPBigQueryAirflowDBTKafka

About the role

Responsibilities

  • Design and build robust ETL/ELT pipelines for both batch and real-time workloads.
  • Implement end-to-end observability, including freshness checks, schema drift detection, and lineage tracking.
  • Maintain data accuracy by defining and enforcing data contracts, SLAs, and SLOs.
  • Optimize warehouse performance and cost through efficient partitioning, clustering, and orchestration.
  • Build scalable data models using dimensional modelling, semantic layers, or Medallion architecture.
  • Partner with product, finance, and compliance teams to translate business requirements into governed data products.
  • Conduct peer reviews of pipeline code to maintain high engineering standards.

Requirements

  • 6+ years of professional experience in data engineering.
  • Proficiency in GCP and BigQuery.
  • Strong expertise in Python and SQL.
  • Hands-on experience with Airflow for orchestration.
  • Experience with transformation tools such as dbt or Dataform.
  • Experience with streaming technologies like Kafka or Pub/Sub.
  • Deep understanding of data modelling techniques (e.g., Kimball, Data Vault, or Medallion).

Preferred Qualifications

  • Background in fintech, trading, or highly regulated financial environments.
  • Experience handling PII and implementing strict access controls and auditability.
  • Experience with warehouse cost optimization and containerized data platforms.

About the Company

Deriv.com is a global fintech company on a mission of "Trading for Anyone, Anywhere, Anytime." We build the high-scale infrastructure that powers real-time trading decisions, fraud detection, and AI/ML systems for millions of users worldwide.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Senior Data Engineer

Deriv.com · Dubai

Sign up to apply