Member of Technical Staff, Model Evaluation

About the Company

Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. We are building a frontier AI research company and training our own models end-to-end, with a team including researchers and engineers from Anthropic, Google DeepMind, xAI, OpenAI, Microsoft, Apple, and MIT.

Responsibilities

• Design and build evaluation frameworks that measure model capabilities along realistic axes, beyond standard benchmarks
• Build automated eval pipelines and regression-detection systems that run continuously and surface signal quickly
• Develop agent-assisted workflows for humans to efficiently inspect model behavior
• Instrument training runs with observability tooling to help researchers understand changes in model behavior
• Partner with post-training and RL teams to close the loop between eval signal and training decisions

Requirements

• Experience building evaluation infrastructure for AI models
• Ability to design frameworks, pipelines, and tooling to measure model behavior
• Interest in the challenges of evaluating frontier AI systems