Infrastructure Engineer

About the Company

Arena Intelligence is the open platform for evaluating how AI models perform in the real world. Born out of UC Berkeley’s SkyLab, their leaderboards are the industry’s gold standard for AI model evaluation, trusted by researchers, developers, and enterprises shaping the future of AI.

Responsibilities

• Build API based products from the ground up, designing low-latency, high-reliability APIs for leaderboards and models
• Solve hard streaming problems including SSE/streaming responses and partial failure recovery
• Ship enterprise-grade infrastructure such as rate limiting, authentication, usage metering, and SOC2 compliance
• Build deep observability with distributed tracing and real-time dashboards
• Integrate with core evaluation platforms and collaborate with research teams to turn ideas into products
• Contribute to backend services for Leaderboards and Evals platforms

Requirements

• 4+ years of backend engineering experience in distributed systems or infrastructure
• Strong proficiency in Go and/or Rust
• Experience building high-throughput APIs or proxy/gateway systems
• Experience with LLM provider APIs (OpenAI, Anthropic, Google, etc.)
• Solid cloud infrastructure skills with AWS or GCP, Kubernetes, Terraform, Postgres, and Redis
• Product-oriented mindset focused on developer experience
• Ability to thrive in a fast-paced startup environment

Preferred Qualifications

• Experience building API gateways, proxies, or developer tools (Kong, Envoy, etc.)
• Background in ML infrastructure, model serving, or evaluation frameworks
• Experience building enterprise features like SSO, RBAC, and multi-tenancy
• Familiarity with the modern AI infra stack (vLLM, LiteLLM, LangChain)

Benefits

• Comprehensive health, dental, and vision insurance
• Equity participation
• Visa sponsorship available