Equities Data Engineer

Responsibilities

• Partner with traders, researchers, and analysts to deliver well-structured data for trading strategies and AI/ML applications
• Build, automate, and maintain resilient pipelines for cleaning, validating, and transforming batch and streaming data
• Develop observability, monitoring, and alerting tools for pipeline reliability
• Optimize tiered data storage and elastic processing across on-prem, cloud, and hybrid environments
• Enforce data governance, controls, and security standards
• Implement data quality frameworks including validation, reconciliation, and anomaly detection
• Maintain point-in-time correctness across datasets to ensure reproducibility of signals and backtests
• Collaborate with infrastructure teams to productionize pipelines and improve runtime efficiency

Requirements

• Over five years of experience designing ingestion pipelines
• Experience processing real-time and batch financial market data
• Strong understanding of financial point-in-time and time-series data
• Expertise in developing data quality control processes
• Experience with monitoring, observability, and alerting systems
• Competence in on-premise Linux systems and cloud platforms
• Proficiency in automated testing, CI/CD, and MLOps
• Knowledge of compressed file formats like Parquet and Iceberg

Preferred Qualifications

• Familiarity with equities, equity indices, futures, or delta one trading data
• Ability to work in an agile, fast-paced trading environment

About the Company

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world.