
Posted 14 hours ago
Senior Data Engineer
Deriv.comSenior Data Engineer
Requirements
6+ years in data engineering, Proficiency in GCP and BigQuery, Experience with Airflow and Python, Knowledge of dbt or Dataform, Experience with Kafka or Pub/Sub, Data modelling expertise (Kimball, Data Vault, or Medallion), Experience in fintech or regulated environments
Skills
GCPBigQueryPythonSQLAirflowDBTKafka
About the role
Responsibilities
- Design and build robust ETL/ELT pipelines for both batch and real-time workloads.
- Implement end-to-end observability, including freshness checks, schema drift detection, and lineage tracking.
- Build and maintain scalable data models using dimensional modelling, semantic layers, or Medallion architecture.
- Define and enforce data contracts, SLAs, and SLOs to ensure data accuracy and reliability.
- Optimize warehouse performance and cost efficiency within GCP and BigQuery.
- Partner with product, finance, and compliance teams to translate business requirements into governed data products.
- Conduct peer reviews and mentor junior engineers to maintain high engineering standards.
Requirements
- 6+ years of professional experience in data engineering.
- Proficiency with GCP and BigQuery.
- Strong experience with Airflow and Python.
- Hands-on experience with dbt or Dataform.
- Experience working with streaming technologies such as Kafka or Pub/Sub.
- Deep expertise in data modelling (e.g., Kimball, Data Vault, or Medallion).
- Experience working within fintech or highly regulated environments.
Preferred Qualifications
- Experience handling PII and implementing strict access controls in a financial context.
- Experience with warehouse cost optimization and containerized data platforms.
- Familiarity with AI-assisted development workflows.
About the Company
Deriv.com is a global fintech company on a mission to provide "Trading for Anyone, Anywhere, Anytime." We build high-scale infrastructure that powers real-time trading decisions, fraud detection, and AI/ML systems for millions of users worldwide.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
Deriv.com · Cyberjaya
