Software Engineer, Model Inference

Responsibilities

• Work alongside machine learning researchers, engineers, and product managers to bring latest technologies into production
• Introduce new techniques, tools, and architecture to improve performance, latency, throughput, and efficiency of the model inference stack
• Build tools to provide visibility into bottlenecks and sources of instability
• Optimize code and Azure VM fleet to maximize utilization of GPU RAM and FLOPs
• Enable advanced research through high-quality engineering

Requirements

• At least 5 years of professional software engineering experience
• Understanding of modern ML architectures and performance optimization for inference
• Experience architecting, building, observing, and debugging production distributed systems
• Ability to own problems end-to-end and learn new technologies quickly

Preferred Qualifications

• Familiarity with PyTorch and NVIDIA GPUs
• Knowledge of software stacks like NCCL and CUDA
• Experience with HPC technologies such as InfiniBand, MPI, and NVLink
• Experience with performance-critical distributed systems

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.