Software Engineer, Caching Infrastructure

Responsibilities

• Design, build, and operate OpenAI’s multi-tenant caching platform used across inference, identity, quota, and product experiences
• Define the long-term vision and roadmap for caching as a core infrastructure capability, balancing performance, durability, and cost
• Collaborate with networking, observability, and database teams to ensure the platform meets diverse product needs

Requirements

• 5+ years of experience building and scaling distributed systems
• Deep expertise with Redis, Memcached, or similar solutions, including clustering and performance tuning
• Production experience with Kubernetes and service meshes like Envoy
• Strong knowledge of load balancing, storage systems, and autoscaling

Preferred Qualifications

• Experience designing systems that minimize tail latency and maximize throughput
• Ability to balance pragmatic engineering with long-term technical excellence in a fast-paced environment

Benefits

• Competitive salary ($230K – $385K) and generous equity
• Comprehensive medical, dental, and vision insurance
• 401(k) retirement plan with employer match
• Flexible PTO and paid parental leave
• Daily meals in the office and mental health support
• Annual learning and development stipend

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of AI capabilities and seek to safely deploy them to the world through products like ChatGPT and our APIs.