Core Data Engineer

Responsibilities

• Own the end-to-end lifecycle of critical real-time data products including Market Data, Trades, and Application Logs
• Build and maintain automated pipelines with a focus on low-latency analytics
• Develop quality checks and systematize manual processing steps
• Create and refine common processing models across data products
• Investigate and onboard new data sources to maximize information value
• Collaborate with cross-functional teams to automate workflows and provide guidance on data architecture

Requirements

• Excellent programming skills in Python
• Proficiency with Linux, SQL, relational databases, and version control
• Proven experience with real-time OLAP databases such as ClickHouse, Apache Pinot, or StarRocks
• Domain literacy in exchange market data, network traffic, or application logs
• Strong organizational skills to manage multiple parallel projects

Preferred Qualifications

• Experience with Airflow, Kafka, and GCP (GKE, Dataproc, BigQuery)
• Experience with Pandas, Spark, Apache Beam, or Apache NiFi
• Deep domain expertise in financial market data

Benefits

• Flow Academy for continuous learning and conference attendance
• Comprehensive health insurance coverage
• Daily catered breakfast and lunch with healthy snacks
• In-house lounge with bar, pool table, and console games
• In-house hairdresser and massage therapist
• Personal trainers, weekly boot camps, and subsidized gym membership
• Annual company trip and various social events

About the Company

Flow Traders is a leading global liquidity provider, focusing on innovation and collaboration through a non-hierarchical approach and cutting-edge technology.