Engineering Manager, ML

About the Company

Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our team is small and talent dense.

Responsibilities

• Lead a team of engineers building infrastructure used to train, test, and evaluate models
• Set technical direction for training and evaluating models at scale
• Work daily with researchers to translate tradeoffs in latency, quality, and cost into infrastructure
• Build rollout infrastructure for RL experiments at scale
• Design evaluation pipelines to catch regressions and provide fast, trustworthy signals
• Own sandboxed, reproducible, and fast environments for model training and testing
• Hire, source, and grow a team of exceptional infrastructure engineers through coaching and mentorship

Requirements

• Experience leading engineering teams building infrastructure for training, evaluating, or serving ML models in production
• Strong fundamentals in infrastructure and distributed systems
• Ability to remain technical, including writing code and performing deep PR reviews
• Proven track record of hiring and developing high-performing engineers
• Ability to communicate fluently with both researchers and systems engineers
• Comfortable operating in ambiguous environments

Preferred Qualifications

• Hands-on experience with RL training infrastructure
• Experience with evaluation frameworks
• Experience building and maintaining simulated environments for model training or testing