Data Platform Engineer

About the Company

Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our team is small and talent dense.

Responsibilities

• Own, operate, and improve Databricks and lakehouse infrastructure as data volume scales
• Build and optimize ingestion systems for first-party product data and 3rd-party business systems
• Ensure observability, alerting, and operational standards across all data infrastructure layers
• Evaluate and roll out data tooling including BI platforms, catalogs, and reverse ETL systems
• Partner with technical and non-technical stakeholders to turn recurring problems into scalable platform solutions
• Optimize TB-scale ingestion and improve resource usage and alerting
• Scale orchestration infrastructure to make it reliable and ergonomic for data scientists and analytics engineers

Requirements

• 4+ years of full-time data platform engineering experience
• Experience building modern data stacks at a low level
• Experience scaling performant ingestion of billions of data points per day
• Experience with data pipeline orchestration infrastructure

Preferred Qualifications

• Experience with Dagster