Senior Data Engineer

Responsibilities

• Own end-to-end data flows including ingestion, normalization, entity resolution, enrichment, and delivery
• Stand up monitoring for freshness, completeness, and accuracy while driving RCA and prevention
• Build internal tools to make data discoverable and usable by engineering and product teams
• Recruit, onboard, and manage BPO vendors and negotiate data partnerships
• Design and run pipelines that clean, enrich, and serve data at massive scale
• Tune storage and compute to optimize cost and performance

Requirements

• Proficiency with Python, Dagster, DuckDB, and Postgres
• Experience building resilient ELT/ETL pipelines with strong contracts, idempotency, and lineage
• Ability to manage data operations, set quality bars, and run SLAs with external partners
• Deep understanding of the technological landscape for high-level system and granular code design

Preferred Qualifications

• Experience with big data and columnar storage formats
• Experience with vector indexes
• Knowledge of privacy and compliance in data products

Benefits

• Generous health, dental, and vision insurance
• 401k with 3% automatic contribution
• Paid lunches
• Wellness and Citi Bike benefit
• Unlimited PTO