Senior Backend Engineer

Responsibilities

• Own the architecture and evolution of core backend microservices powering the AI inference platform
• Design and build production-grade APIs using REST, gRPC, and GraphQL
• Build and scale enterprise-grade platform capabilities including authentication, RBAC, and billing
• Develop AI-specific platform features and LLM deployment workflows
• Design and optimize data models across PostgreSQL and ClickHouse systems
• Collaborate with infrastructure engineers on multi-cloud deployment and orchestration
• Set reliability and performance standards and drive engineering quality through CI/CD

Requirements

• 5+ years of backend or systems engineering experience in production environments
• Bachelor's or Master's degree in Computer Science or equivalent
• Expertise in Python and modern frameworks like FastAPI
• Strong experience designing and operating distributed systems at scale
• Proficiency in data modeling and SQL with PostgreSQL and OLAP experience
• Working knowledge of LLM serving
• Experience building secure, multi-tenant SaaS architectures
• Familiarity with cloud-native development and observability tooling

Preferred Qualifications

• Hands-on experience with AI or model serving infrastructure
• Experience with Kubernetes for production container orchestration
• Background building developer-facing SDKs, CLIs, or internal platforms
• Exposure to multi-cloud environments
• Experience leading incident response and postmortems
• Basic familiarity with React or Next.js

Benefits

• Flexible working hours
• Daily lunch and dinner provided
• Health check-up support and top-tier hardware
• Startup equity and competitive compensation

About the Company

FriendliAI is building the world’s best AI inference platform that makes large language and multi-modal models fast, efficient, and deployable at scale.