
Posted 8 hours ago
Software Engineer, Accelerators
OpenAI
Requirements
3+ years AI infrastructure experience, Experience with accelerator platforms, Knowledge of kernels and sharding, Performance modeling skills
Skills
PyTorchAI InfrastructureDistributed Systems
About the role
Responsibilities
- Prototype and enable OpenAI's AI software stack on new, exploratory accelerator platforms
- Optimize large-scale model performance for diverse hardware environments
- Develop kernels, sharding mechanisms, and system scaling strategies tailored to emerging accelerators
- Collaborate on optimizations at the model code level and below to enhance performance
- Perform system-level performance modeling, debug bottlenecks, and drive end-to-end optimization
- Work with hardware teams and vendors to evaluate alternatives to existing platforms
- Contribute to runtime improvements, compute/communication overlapping, and scaling efforts
Requirements
- 3+ years of experience in AI infrastructure, kernels, systems, or hardware-software co-design
- Hands-on experience with accelerator platforms for AI at data center scale
- Strong understanding of kernels, sharding, runtime systems, or distributed scaling techniques
- Familiarity with optimizing LLMs, CNNs, or recommender models for hardware efficiency
- Experience with performance modeling, system debugging, and software stack adaptation
- Ability to operate across multiple levels of the stack and navigate ambiguity
Preferred Qualifications
- Exposure to mobile accelerators
- Experience enabling data center-scale AI hardware
About the Company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSoftware Engineer, Accelerators
OpenAI · San Francisco
