
Posted 11 hours ago
Agent Post-Training, Frontier Evals and Environments Researcher
OpenAIAgent Post-Training, Frontier Evals and Environments Research
Requirements
Strong technical fundamentals in ML, software engineering, or statistics, Hands-on experience with LLMs, RL, or RLHF, Experience with post-training, evals, or synthetic data, Ability to design and run experiments
Skills
Machine LearningLLMPyTorchNLPComputer VisionLangChainTensorFlowDeep LearningGenAISparkPySparkApache SparkRAGMLOpsData Science
About the role
Responsibilities
- Create ambitious RL environments to push models to their limits and measure frontier capabilities, skills, and behaviors
- Develop new methodologies for automatically exploring model behavior
- Dive deep into the science of measurement, including scalability, reliability, and variance of evaluation methodology
- Help steer training for major training runs
- Design scalable systems and processes to support continuous evaluation
- Build self-improvement loops to automate model understanding
Requirements
- Strong technical fundamentals in machine learning, software engineering, systems, or statistics
- Hands-on experience with LLMs, RL, RLHF/RLAIF, post-training, evals, graders, synthetic data, or production ML systems
- Ability to move from vague behavioral problems to concrete experiments
- Experience defining hypotheses, building pipelines, and analyzing results
- Ability to communicate clearly across research, product, infrastructure, and safety teams
About the Company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeAgent Post-Training, Frontier Evals and Environments Researcher
OpenAI · San Francisco
