P
Posted 9 hours ago
Data Annotation Lead
Physical IntelligenceData Annotation Lead
Requirements
7+ years leading scaled data operations, 3+ years managing managers, Experience with human-in-the-loop workflows, Understanding of ML
Skills
Machine LearningOperations
About the role
About the Company
Physical Intelligence is bringing general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing foundation models and learning algorithms to power the robots of today and the physically-actuated devices of the future.
Responsibilities
- Own annotation operations end-to-end including throughput, quality, cost, and on-time delivery
- Scale the annotation workforce from 100s to 1,000s through workforce planning and org design
- Build and lead a multi-layer management structure, managing managers and team leads
- Scale throughput using autolabeling and model-based human-in-the-loop workflows
- Stand up training and certification pipelines to ensure consistent quality
- Define quality rubrics, calibration, and audit/QA loops
- Establish operational metrics and reporting to drive week-over-week improvement
- Manage the annotation operating budget and unit economics
- Partner with product, engineering, and research to define tooling and translate needs into instructions
Requirements
- 7+ years leading scaled data or annotation operations with teams of 100+
- 3+ years experience as a manager of managers
- Proven track record of standing up 0→1 annotation programs
- Experience integrating autolabeling and model-based annotation into human workflows
- Fluency with operational and quality metrics for large workforce management
- Strong cross-functional partnership skills with product, engineering, and ML teams
- Working understanding of Machine Learning and the impact of annotation quality on model performance
Preferred Qualifications
- Experience in robotics, autonomous vehicles, or frontier-AI data pipelines
- Experience managing distributed, global, or vendor workforces
- Experience building annotation tooling or partnering with tooling teams
- Experience training or fine-tuning autolabeling models
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Annotation Lead
Physical Intelligence · San Francisco
