Technical Lead Manager

Responsibilities

• Design and build a unified dataset read platform for multiple current and future training frameworks
• Define dataset APIs, storage-format expectations, registration, versioning, and migration paths
• Build reliability into the read path, including stateful iteration, caching, fast restart, and recovery
• Build terminal and web-based visualizers for inspecting text, multimodal, and reinforcement learning data
• Write and review production code in core data loading, service, caching, and reliability paths
• Partner with teams working on training frameworks, reinforcement learning, multimodal models, and cluster infrastructure

Requirements

• Experience building or owning dataset, data loading, storage, or distributed training infrastructure at large scale
• Understanding of failure modes in large distributed training jobs
• Experience with stateful iterators, checkpoint/restart semantics, caching, or high-throughput storage reads
• Proficiency in Python and comfort working with lower-level systems code
• Experience with multimodal, video, reinforcement learning, or pretraining data pipelines
• Ability to lead through code and technical judgment and manage engineers

Preferred Qualifications

• Experience with Rust or C++

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.