Agent Post-Training, Connectors Research

Responsibilities

• Design and run experiments to improve agentic model behavior for complex software and plugins
• Own end-to-end improvements to the post-training stack, including RL, data pipelines, graders, and reward signals
• Build evals and environments that expose model failures and translate them into training data or research directions
• Partner with Codex and ChatGPT product teams to translate user needs into model improvements
• Work on early-training and alignment interventions, including data mixtures, synthetic data, and eval loops
• Improve large-scale training machinery, focusing on experiment velocity, reliability, and production readiness
• Debug hard failures in shipped models and turn qualitative behavior into concrete hypotheses and fixes

Requirements

• Strong technical fundamentals in machine learning, software engineering, systems, or statistics
• Hands-on experience with Large Language Models (LLMs)
• Experience with Reinforcement Learning (RL) or RLHF/RLAIF
• Experience with post-training, evals, graders, or synthetic data
• Experience with production ML systems
• Ability to move from vague behavioral problems to concrete, actionable experiments

Preferred Qualifications

• Experience building coding agents or tool-using agents
• Experience working across research, product, and infrastructure boundaries
• A strong interest in the intersection of model behavior and real-world product impact

Benefits

• Medical, dental, and vision insurance for you and your family
• 401(k) retirement plan with employer match
• Paid parental leave (up to 24 weeks for birth parents)
• Flexible PTO and 13+ paid company holidays
• Mental health and wellness support
• Daily meals in our offices and meal delivery credits
• Annual learning and development stipend
• Relocation support for eligible employees

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.