Agent Post-Training, API & Power Users at OpenAI - ScoutJobs - The AI-curated global job board
Skip to content
OpenAI
Posted 8 hours ago

Agent Post-Training, API & Power Users

OpenAI

Requirements

Strong technical fundamentals in ML or software engineering, Hands-on experience with LLMs and post-training, Experience with RL/RLHF/RLAIF, Experience with evals and synthetic data

Skills

LLMMachine LearningRLHF

About the role

Responsibilities

  • Design and run experiments to improve model behavior in API and power-user workflows, including function calling, tool use, and planning
  • Build evals, graders, and environments from real developer workflows to turn failures into training data
  • Partner with API and power-users to identify behavior gaps and convert product signals into post-training interventions
  • Improve model behavior when composed into systems, ensuring reliability in tool use and multi-step tasks
  • Own end-to-end model behavior projects from qualitative failure analysis through data generation and training experiments
  • Develop feedback loops using power-user traces and API usage patterns to discover agentic model failures
  • Debug hard failures in shipped models by analyzing traces, evals, and training data
  • Work on early-training and alignment interventions, including data mixtures and synthetic data

Requirements

  • Strong technical fundamentals in ML, software engineering, systems, or statistics
  • Hands-on experience with LLMs, post-training, RL/RLHF/RLAIF, or production ML systems
  • Experience with evals, graders, synthetic data, or coding/tool-using agents
  • Ability to form concrete hypotheses from qualitative model failures or API interactions
  • Comfortable working across research, product, infrastructure, and safety boundaries

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Agent Post-Training, API & Power Users

OpenAI · San Francisco

Sign up to apply