Posted 10 hours ago
Research Engineer, Frontier Evals & Environments
OpenAI
Requirements
Strong technical fundamentals in ML, software engineering, or statistics, Hands-on experience with LLMs, RL, or RLHF, Experience with post-training, evals, or synthetic data, Ability to design scalable evaluation systems
Skills
Machine LearningLLM
About the role
Responsibilities
- Create ambitious RL environments to push models to their limits and measure frontier capabilities
- Develop new methodologies for automatically exploring model behavior
- Dive deep into the science of measurement, including scalability, reliability, and variance
- Help steer training for major model runs
- Design scalable systems and processes to support continuous evaluation
- Build self-improvement loops to automate model understanding
Requirements
- Strong technical fundamentals in machine learning, software engineering, systems, or statistics
- Hands-on experience with LLMs, RL, RLHF/RLAIF, post-training, or evals
- Experience with synthetic data, model training, or production ML systems
- Ability to move from vague behavioral problems to concrete experiments
- Strong communication skills to work across research, product, and safety teams
About the Company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeResearch Engineer, Frontier Evals & Environments
OpenAI · San Francisco
