
Posted 5 hours ago
Software Engineer, AI Data & Evaluation
MercorSoftware Engineer, AI Data & Evaluation
Perks & benefits
Education AllowanceHealth InsuranceRelocation Allowance
Requirements
Software engineering production experience, AI/ML data pipeline experience, Systems design skills, Experience in fast-paced environments
Skills
AIMachine LearningData Engineering
About the role
About the Company
Mercor's mission is to organize human intelligence to power the AI economy. We partner with leading AI labs and enterprises to provide the human intelligence essential to AI development. Mercor is a profitable Series C company valued at $10 billion.
Responsibilities
- Innovate and develop evaluation methodologies and flywheels that continuously improve data quality and model performance at scale
- Design and build synthetic data generation systems and simulation environments that produce high-signal, high-diversity training data
- Architect and ship operational automation systems that maximize throughput, efficiency, and quality across the end-to-end data pipeline
- Collaborate cross-functionally with Operations, Research, and Product to translate evolving model needs into robust, scalable engineering solutions
- Own end-to-end delivery of critical systems from prototyping to scaling production infrastructure
Requirements
- Strong software engineering skills with a proven track record shipping production systems end-to-end
- Deep interest in and experience with AI/ML data pipelines, evaluation frameworks, or training data systems
- Systems thinking with the ability to design for scalability, quality, and operational reliability
- Ability to operate with ownership and pragmatism in fast-moving, ambiguous environments
- Effective communication and collaboration skills
Preferred Qualifications
- Experience with synthetic data generation
- Experience with reinforcement learning environments
- Experience with large-scale data quality systems
Benefits
- Bi-annual performance bonus structure
- Generous equity grant vested over 4 years
- Up to $15k Relocation bonus
- $10K proximity bonus
- $1.5K monthly stipend for meals
- Free Equinox membership
- $200 monthly laundry reimbursement
- $200 monthly personal wellness reimbursement
- Health, Dental, Vision insurance
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSoftware Engineer, AI Data & Evaluation
Mercor · San Francisco
