Software Engineer, AI Data & Evaluation at Mercor - ScoutJobs - The AI-curated global job board
Skip to content
Mercor
Posted 5 hours ago

Software Engineer, AI Data & Evaluation

MercorSoftware Engineer, AI Data & Evaluation

Perks & benefits

Education AllowanceHealth InsuranceRelocation Allowance

Requirements

Software engineering production experience, AI/ML data pipeline experience, Systems design skills, Experience in fast-paced environments

Skills

AIMachine LearningData Engineering

About the role

About the Company

Mercor's mission is to organize human intelligence to power the AI economy. We partner with leading AI labs and enterprises to provide the human intelligence essential to AI development. Mercor is a profitable Series C company valued at $10 billion.

Responsibilities

  • Innovate and develop evaluation methodologies and flywheels that continuously improve data quality and model performance at scale
  • Design and build synthetic data generation systems and simulation environments that produce high-signal, high-diversity training data
  • Architect and ship operational automation systems that maximize throughput, efficiency, and quality across the end-to-end data pipeline
  • Collaborate cross-functionally with Operations, Research, and Product to translate evolving model needs into robust, scalable engineering solutions
  • Own end-to-end delivery of critical systems from prototyping to scaling production infrastructure

Requirements

  • Strong software engineering skills with a proven track record shipping production systems end-to-end
  • Deep interest in and experience with AI/ML data pipelines, evaluation frameworks, or training data systems
  • Systems thinking with the ability to design for scalability, quality, and operational reliability
  • Ability to operate with ownership and pragmatism in fast-moving, ambiguous environments
  • Effective communication and collaboration skills

Preferred Qualifications

  • Experience with synthetic data generation
  • Experience with reinforcement learning environments
  • Experience with large-scale data quality systems

Benefits

  • Bi-annual performance bonus structure
  • Generous equity grant vested over 4 years
  • Up to $15k Relocation bonus
  • $10K proximity bonus
  • $1.5K monthly stipend for meals
  • Free Equinox membership
  • $200 monthly laundry reimbursement
  • $200 monthly personal wellness reimbursement
  • Health, Dental, Vision insurance
ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Software Engineer, AI Data & Evaluation

Mercor · San Francisco

Sign up to apply