Software Engineer (Backend), Enterprise

Responsibilities

• Design, build, and scale backend systems that power enterprise GenAI products, focusing on reliability and performance.
• Develop core services and APIs that integrate AI models and enterprise data sources securely and efficiently.
• Architect scalable distributed systems for data processing, inference, and orchestration of large-scale GenAI workloads.
• Optimize backend performance for latency, throughput, and cost across hybrid and multi-cloud environments.
• Manage and evolve cloud infrastructure (AWS, Azure, or GCP) through automation, observability, and security.
• Collaborate with ML and product teams to bring cutting-edge GenAI models into production via efficient model serving systems.

Requirements

• 4+ years of experience developing large-scale backend or infrastructure systems.
• Proficiency in Python or TypeScript.
• Experience designing high-performance APIs using frameworks such as FastAPI, Flask, Express, or NestJS.
• Deep familiarity with cloud infrastructure (AWS and Azure preferred) and container orchestration (Kubernetes, Docker).
• Experience with Infrastructure-as-Code tools like Terraform.
• Experience managing relational and NoSQL databases (e.g., PostgreSQL, DynamoDB).
• Hands-on experience with GenAI applications, model integration, or AI agent systems.
• Strong understanding of observability, CI/CD, and security best practices for multi-tenant environments.

About the Company

Scale AI is pioneering the next era of enterprise AI. Our mission is to develop reliable AI systems for the world's most important decisions. We provide the high-quality data and full-stack technologies that power the world's leading models, helping enterprises and governments build, deploy, and oversee AI applications that deliver real impact.