Senior Software Engineer, ML Evaluation Infra and Efficiency

About the Company

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and has provided over ten million rider-only trips.

Responsibilities

• Design and build distributed evaluation platforms for large-scale ML evaluation workloads
• Profile evaluation platforms, identify performance bottlenecks, and implement optimizations to improve inference speed and resource utilization
• Collaborate with ML engineers to understand evaluation requirements and improve DevX of the evaluation infrastructure
• Improve runtime goodput of ML inference workload and efficiency of metrics computations
• Implement and maintain advanced ML infrastructure tools, including ML Pathways, JAX, Flume and TensorFlow

Requirements

• B.S. in Computer Science, Math, or 3+ years equivalent real-world experience
• Proficient in distributed systems design with an understanding of ML efficiency
• Experience with ML frameworks, including TensorFlow, JAX, XLA
• Solid programming skills in Python and C++
• Practical familiarity with profiling tools to uncover performance bottlenecks

Preferred Qualifications

• MS in Computer Science or Math
• Familiarity with large-scale evaluation platforms for LLMs