Software Engineer, Productivity - Inference Runtime

Responsibilities

• Improve systems ensuring inference engine releases are correct, performant, and regression-free
• Evolve tooling and infrastructure for deploy gate validation
• Bring rigor to release, validation, branching, and deployment processes
• Improve canary, async, and large-scale validation workflows for inference systems
• Harden CI, testing, and validation infrastructure to ensure actionable and trustworthy failures
• Reduce noisy or flaky failures caused by infrastructure instability or GPU scheduling
• Build automation for failure triage, ownership detection, debugging, and escalation
• Partner with inference, research productivity, and infrastructure teams to improve rollout safety
• Reduce developer friction in testing and release workflows

Requirements

• Strong experience with CI/CD systems, testing infrastructure, or release tooling
• Experience with large-scale build and validation systems
• Proficiency in Python-heavy environments
• Ability to debug complex distributed systems
• High ownership and proactive problem-solving skills
• Ability to work in ambiguous areas without a predefined roadmap

Preferred Qualifications

• C++ experience for working near inference engine code or performance-sensitive systems
• Experience with large-scale inference systems

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.