Software Engineer, GPU Infrastructure

Responsibilities

• Design, build, and operate software that manages large-scale GPU infrastructure supporting ChatGPT inference.
• Build internal platforms, tooling, and AI-powered agents to automate fleet operations and reduce operational overhead.
• Improve observability, reliability, and operational efficiency across thousands of GPUs.
• Develop systems for capacity planning, scheduling, fleet health monitoring, and incident response.
• Identify infrastructure bottlenecks and implement solutions to improve utilization, scalability, and performance.
• Partner with research, platform, networking, and systems teams to continuously improve the compute platform.

Requirements

• 5+ years of software engineering experience building production infrastructure.
• Strong programming skills in Go, Python, C++, Rust, or similar systems languages.
• Experience designing and operating highly available distributed systems.
• Experience with GPU infrastructure, high-performance computing, ML infrastructure, or large-scale compute platforms.
• Experience with Kubernetes, cloud infrastructure, Linux, networking, and observability tooling.
• Excellent debugging, systems design, and operational problem-solving skills.

Preferred Qualifications

• Background in Production Engineering, Site Reliability Engineering (SRE), or Platform Engineering.
• Experience building software that automates complex operational workflows.
• Ability to thrive in fast-moving environments with significant technical ambiguity.

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We build AI systems that are capable, aligned, and broadly beneficial, powering products that bring these systems to millions of users worldwide.