
Posted 10 hours ago
Backend Software Engineer
OpenAIBackend Software Engineer (Evals)
Requirements
4+ years backend engineering experience, Proficiency in Python, FastAPI, and Postgres, Experience with distributed systems or APIs, Experience building AI agents or LLM applications, Familiarity with LLM evaluation methods
Skills
PythonFastAPIPostgreSQLLLMDistributed Systems
About the role
Responsibilities
- Design reliable, reproducible, and extendable evaluation pipelines
- Build infrastructure for continuous evaluation monitoring frameworks, including regression/drift monitoring and golden datasets
- Design, build, and maintain backend services and APIs to support intelligent automation and knowledge systems
- Integrate and structure data across internal platforms for use by downstream systems and AI workflows
- Collaborate with data science and research teams to integrate OpenAI models into high-leverage workflows
- Own the full development lifecycle of new backend systems and internal platform capabilities
Requirements
- 4+ years of backend engineering experience at product-driven companies
- Proficiency in Python, FastAPI, and Postgres
- Experience designing and scaling distributed systems, APIs, or data processing pipelines
- Experience building AI agents or applications, including designing evals and improving performance through prompting or scaffolding
- Familiarity with LLM evaluation methods and patterns like multi-agent workflows, tool use, or long context
- Experience creating production evals or measuring the performance of ML/LLM models at scale
Preferred Qualifications
- A pragmatic mindset with the ability to ship iteratively while building toward a long-term vision
- Experience working in ML/LLM-heavy domains
Benefits
- Competitive salary ($230K – $385K) and generous equity
- Medical, dental, and vision insurance
- 401(k) retirement plan with employer match
- Paid parental leave and flexible PTO
- Daily meals in the office and meal delivery credits
- Annual learning and development stipend
- Relocation support for eligible employees
About the Company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeBackend Software Engineer
OpenAI · San Francisco
