
Posted 9 hours ago
Backend Software Engineer
OpenAIBackend Software Engineer (Evals)
Requirements
4+ years backend engineering experience, Proficiency in Python, FastAPI, and Postgres, Experience with distributed systems and APIs, Experience building AI agents or LLM applications, Knowledge of LLM evaluation methods
Skills
PythonFastAPIPostgreSQL
About the role
Responsibilities
- Design reliable, reproducible, and extendable eval pipelines
- Build infrastructure for continuous eval monitoring frameworks, including regression/drift monitoring and golden datasets
- Design, build, and maintain backend services and APIs to support intelligent automation and knowledge systems
- Integrate and structure data across internal platforms for AI workflows
- Collaborate with data, research, and engineering teams to integrate OpenAI models into workflows
- Own the full development lifecycle of new backend systems and internal platform capabilities
Requirements
- 4+ years of backend engineering experience at product-driven companies
- Proficiency in Python, FastAPI, and Postgres
- Experience designing and scaling distributed systems, APIs, or data processing pipelines
- Experience building AI agents or applications, including designing evals and performance improvement
- Familiarity with LLM evaluation methods, multi-agent workflows, tool use, or long context
- Experience creating production evals or measuring ML/LLM model performance at scale
About the Company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeBackend Software Engineer
OpenAI · San Francisco
