Senior Backend Engineer

Responsibilities

• Own the architecture and evolution of core backend microservices powering the AI inference platform
• Design and build production-grade APIs using REST, gRPC, and GraphQL
• Build and scale enterprise-grade platform capabilities including authentication, RBAC, billing, and multi-tenant SaaS infrastructure
• Develop AI-specific platform features and LLM deployment workflows
• Design and optimize data models and pipelines across PostgreSQL and ClickHouse
• Collaborate with infrastructure engineers on multi-cloud deployment and resource orchestration
• Set reliability and performance standards and resolve production issues
• Drive engineering quality through design reviews, automated testing, and CI/CD

Requirements

• 5+ years of backend or systems engineering experience in production environments
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent
• Expertise in Python and modern frameworks like FastAPI
• Strong experience designing and operating distributed systems at scale
• Solid API design experience across REST, gRPC, and GraphQL
• Proficiency in data modeling and SQL with experience in PostgreSQL and ClickHouse
• Working knowledge of LLM serving
• Experience building secure, multi-tenant SaaS architectures
• Familiarity with cloud-native development and observability tooling

Preferred Qualifications

• Hands-on experience with AI or model serving infrastructure
• Experience with Kubernetes for production container orchestration
• Background building developer-facing SDKs, CLIs, or internal engineering platforms
• Exposure to multi-cloud environments
• Experience leading incident response and postmortems
• Basic familiarity with React or Next.js

Benefits

• Flexible working hours
• Daily lunch and dinner provided
• Unlimited snacks and beverages
• Health check-up support
• Top-tier equipment and hardware support
• Competitive compensation and startup equity

About the Company

FriendliAI is building the world’s best AI inference platform that makes large language and multi-modal models fast, efficient, and deployable at scale. We power high-throughput, low-latency AI workloads for organizations worldwide.