Distinguished Engineer, Data Platform at CloudZero - ScoutJobs - The AI-curated global job board
Skip to content
CloudZero
Posted 4 hours ago

Distinguished Engineer, Data Platform

CloudZero

Requirements

10+ years data engineering experience, Large-scale data platform operation, Streaming systems expertise, Open table formats fluency, Dimensional data modeling, Distributed query engines

Skills

KafkaApache IcebergFlinkSQLTrino

About the role

Responsibilities

  • Lead end-to-end technical design for the next-generation data platform, including event ingestion, stream processing, and the query layer
  • Design and deliver real-time data pipelines with established SLOs for throughput and latency
  • Redesign the dimensional cost model to support high-cardinality, multi-dimensional cost attribution
  • Evolve the query engine layer and optimize performance across partition pruning and query planning
  • Partner with product and infrastructure teams to define a multi-year data platform roadmap
  • Mentor senior and staff engineers through architecture reviews and design patterns

Requirements

  • 10+ years in data engineering with experience in principal or staff-level architecture
  • Proven experience building and operating large-scale data platforms serving tens of millions of events per day
  • Deep expertise with streaming systems like Kafka, Kinesis, Flink, or Spark Streaming
  • Hands-on fluency with open table formats such as Apache Iceberg, Delta Lake, or Hudi
  • Expert knowledge of dimensional data modeling and cardinality management
  • Strong background in SQL and query optimization for distributed engines like Trino, Presto, or Spark SQL
  • Experience driving complex, multi-month technical initiatives from inception to production

Preferred Qualifications

  • FinOps or cloud cost domain experience
  • Multi-cloud data ingestion experience (AWS, Azure, GCP)
  • Production-scale experience with Apache Flink
  • Knowledge of Lakehouse architecture patterns
  • Open source contributions to the data ecosystem

About the Company

CloudZero is a SaaS platform at the intersection of next-generation cloud cost management and FinOps. We ingest billing and usage data from all cloud, SaaS, and PaaS providers to empower organizations to make informed business decisions regarding cloud efficiency.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Distinguished Engineer, Data Platform

CloudZero · San Francisco

Sign up to apply