Forward Deployed Engineer

About the Company

Novita AI is an AI & Agent Cloud platform for builders. We provide a unified platform for Model APIs, GPU Cloud, and Agent Sandbox infrastructure, helping developers and enterprises build, deploy, and scale production AI systems without managing complex infrastructure.

Responsibilities

• Work directly with customers to understand their AI products, technical requirements, and business goals
• Deploy and integrate Novita AI products including Model APIs, dedicated model hosting, GPU cloud infrastructure, and agent sandbox environments
• Debug production issues across APIs, networking, containers, GPUs, and distributed systems
• Build customer-specific solutions, integrations, demos, and prototypes
• Translate customer feedback into product requirements for internal engineering teams
• Create reusable tooling, automation, and reference implementations
• Support proof-of-concepts (PoCs) and help customers move into production

Requirements

• Strong software engineering fundamentals
• Proficiency in Python and at least one additional programming language
• Experience building or deploying cloud-native applications
• Familiarity with Docker, Kubernetes, Linux, and networking concepts
• Strong debugging and problem-solving skills in production environments
• Excellent communication skills and ability to work directly with customers
• Ability to operate with ambiguity in a startup environment

Preferred Qualifications

• Experience with AI/ML infrastructure, LLMs, or inference systems
• Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks
• Experience working with GPUs, CUDA, or large-scale compute systems
• Background in solutions engineering, developer relations, or customer-facing engineering roles
• Experience building AI agents or sandboxed execution environments
• Professional working proficiency in Mandarin Chinese