Backend Software Engineer at OpenAI - ScoutJobs - The AI-curated global job board
Skip to content
OpenAI
Posted 10 hours ago

Backend Software Engineer

OpenAIBackend Software Engineer (Evals)

Requirements

4+ years backend engineering experience, Proficiency in Python, FastAPI, and Postgres, Experience with distributed systems or APIs, Experience building AI agents or LLM applications, Familiarity with LLM evaluation methods

Skills

PythonFastAPIPostgreSQLLLMDistributed Systems

About the role

Responsibilities

  • Design reliable, reproducible, and extendable evaluation pipelines
  • Build infrastructure for continuous evaluation monitoring frameworks, including regression/drift monitoring and golden datasets
  • Design, build, and maintain backend services and APIs to support intelligent automation and knowledge systems
  • Integrate and structure data across internal platforms for use by downstream systems and AI workflows
  • Collaborate with data science and research teams to integrate OpenAI models into high-leverage workflows
  • Own the full development lifecycle of new backend systems and internal platform capabilities

Requirements

  • 4+ years of backend engineering experience at product-driven companies
  • Proficiency in Python, FastAPI, and Postgres
  • Experience designing and scaling distributed systems, APIs, or data processing pipelines
  • Experience building AI agents or applications, including designing evals and improving performance through prompting or scaffolding
  • Familiarity with LLM evaluation methods and patterns like multi-agent workflows, tool use, or long context
  • Experience creating production evals or measuring the performance of ML/LLM models at scale

Preferred Qualifications

  • A pragmatic mindset with the ability to ship iteratively while building toward a long-term vision
  • Experience working in ML/LLM-heavy domains

Benefits

  • Competitive salary ($230K – $385K) and generous equity
  • Medical, dental, and vision insurance
  • 401(k) retirement plan with employer match
  • Paid parental leave and flexible PTO
  • Daily meals in the office and meal delivery credits
  • Annual learning and development stipend
  • Relocation support for eligible employees

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Backend Software Engineer

OpenAI · San Francisco

Sign up to apply