TL, Research Inference

Responsibilities

• Design and build high-performance inference runtimes for large-scale AI models
• Own and optimize core execution paths including memory management, batching, and scheduling
• Develop and improve distributed inference across multiple GPUs
• Implement and optimize inference-critical operators and kernels
• Partner with research teams to support new model architectures in inference systems
• Diagnose and resolve performance bottlenecks through profiling and benchmarking

Requirements

• Experience building production inference systems
• Expertise in GPU-centric performance engineering and memory behavior
• Experience with multi-GPU or distributed systems involving batching and scheduling
• Ability to reason end-to-end about inference pipelines
• Ability to implement research ideas within real system and performance constraints

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.