A
Posted 13 hours ago
Backend Engineer, AI
A1Backend Engineer, AI (Agent Systems)
Requirements
Backend engineering fundamentals, High-throughput service experience, AI inference patterns familiarity, Distributed systems debugging
Skills
PythonLLMKubernetes
About the role
About the Company
A1 is on a mission to build a proactive smart assistant for everyday users, bringing intelligence to conversations, errands, organizing, and workflows with minimal prompting. We focus on high reliability for long-running workflows, persistent context, and real-world task completion.
Responsibilities
- Build and operate backend systems that serve AI-powered features in production
- Design inference pipelines, orchestration layers, and service boundaries around models
- Own production concerns including monitoring, logging, alerting, and incident response
- Optimize latency and throughput across inference, caching, batching, and streaming
Requirements
- Strong backend engineering fundamentals in production environments
- Experience running high-throughput, low-latency services
- Familiarity with AI inference patterns such as LLMs, embeddings, and multimodal models
- Ability to debug distributed systems under load
- Bias toward shipping and learning from production behavior
Preferred Qualifications
- Proficiency with Python, NodeJs, and PyTorch
- Experience with OpenAI, Anthropic, or open-source LLMs
- Knowledge of SQL, NoSQL, Kubernetes, and Docker
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeBackend Engineer, AI
A1 · China
