Senior Data Engineer

Responsibilities

• Model, build, and manage data products built atop DRW’s Unified Data Platform
• Work with Data Strategists to onboard and manage new datasets for trading, research, and back-office purposes
• Design data governance processes including discovery, cost-sharing, usage tracking, and access controls
• Monitor data ingestion pipelines and data quality to ensure stability and reliability
• Own technical aspects of vendor ingestion pipelines and participate in on-call rotation
• Respond to user requests to identify platform gaps and self-service opportunities

Requirements

• 7+ years of experience with modern data technologies and building data-first products
• Extensive familiarity with SQL and Java or Python
• Experience with data processing technologies such as Flink, Spark, Polars, or Dask
• Experience with data storage technologies like S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, or Kafka
• Experience with data formats such as Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, or JSON
• Experience managing orchestration systems like Kubernetes, Argo Workflows, Airflow, Prefect, or Dagster
• Proven experience managing operational aspects of large data pipelines including backfilling and monitoring throughput
• Strong technical problem-solving and communication skills

About the Company

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world.