
Posted 4 hours ago
Distinguished Engineer, Data Platform
CloudZero
Requirements
10+ years data engineering experience, Large-scale data platform operation, Streaming systems expertise, Open table formats fluency, Dimensional data modeling, Distributed query engines
Skills
KafkaApache IcebergFlinkSQLTrino
About the role
Responsibilities
- Lead end-to-end technical design for the next-generation data platform, including event ingestion, stream processing, and the query layer
- Design and deliver real-time data pipelines with established SLOs for throughput and latency
- Redesign the dimensional cost model to support high-cardinality, multi-dimensional cost attribution
- Evolve the query engine layer and optimize performance across partition pruning and query planning
- Partner with product and infrastructure teams to define a multi-year data platform roadmap
- Mentor senior and staff engineers through architecture reviews and design patterns
Requirements
- 10+ years in data engineering with experience in principal or staff-level architecture
- Proven experience building and operating large-scale data platforms serving tens of millions of events per day
- Deep expertise with streaming systems like Kafka, Kinesis, Flink, or Spark Streaming
- Hands-on fluency with open table formats such as Apache Iceberg, Delta Lake, or Hudi
- Expert knowledge of dimensional data modeling and cardinality management
- Strong background in SQL and query optimization for distributed engines like Trino, Presto, or Spark SQL
- Experience driving complex, multi-month technical initiatives from inception to production
Preferred Qualifications
- FinOps or cloud cost domain experience
- Multi-cloud data ingestion experience (AWS, Azure, GCP)
- Production-scale experience with Apache Flink
- Knowledge of Lakehouse architecture patterns
- Open source contributions to the data ecosystem
About the Company
CloudZero is a SaaS platform at the intersection of next-generation cloud cost management and FinOps. We ingest billing and usage data from all cloud, SaaS, and PaaS providers to empower organizations to make informed business decisions regarding cloud efficiency.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeDistinguished Engineer, Data Platform
CloudZero · San Francisco
