Software Engineer, Inference - Multi Modal

Responsibilities

• Design and implement inference infrastructure for large-scale multimodal models
• Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs
• Enable experimental research workflows to transition into reliable production services
• Collaborate closely with researchers, infra teams, and product engineers to deploy state-of-the-art capabilities
• Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction layers

Requirements

• Experience building and scaling inference systems for LLMs or multimodal models
• Experience with GPU-based ML workloads and performance dynamics of large models
• Familiarity with inference tooling like vLLM, TensorRT-LLM, or custom model parallel systems
• Ability to work with systems spanning networking, distributed compute, and high-throughput data handling

Preferred Qualifications

• Experience working with image generation or audio synthesis models in production
• Exposure to distributed ML training or system-efficient model design

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.