Applied AI Engineer

Responsibilities

• Design and iterate on agent behaviors across real-world coding tasks and long-horizon workflows
• Work closely with research to develop and run evals to measure agent performance, regressions, failure modes, and edge cases
• Improve performance through prompting, tool-use strategies, context construction, and model-facing experimentation
• Analyze failures in production and systematically improve robustness and reliability
• Build feedback loops and data systems that get better real-task data into evaluation and research
• Work with product teams to shape user-facing agent experiences and the interfaces the agent depends on
• Help define what “good” looks like for agents completing complex tasks end-to-end

Requirements

• Experience building or shipping machine learning or LLM-powered products
• Strong proficiency in Python
• Comfort with modern ML tooling
• Experience with model evaluation, fine-tuning, or prompt design
• Systems-thinking approach focused on user outcomes
• Ability to debug complex, real-world failures

Preferred Qualifications

• Experience with agent frameworks or tool-using LLM systems
• Research experience with code generation models or developer tooling
• Experience working with large, messy datasets or production logs

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.