Software Engineer (AI Platforms)

About the Company

At SingleStore, we’re not just building a database company, we’re defining the future of data management. We offer customers flexible networking, storage, and compute options using the latest capabilities of major cloud providers and the Kubernetes ecosystem.

Responsibilities

• Build and evolve backend services that power AI features: agent orchestration, tool execution, retrieval/RAG pipelines, and model serving integrations.
• Design APIs and control plane workflows for AI platform components.
• Implement MCP style tool discovery and integration patterns.
• Work closely with product managers, designers, and customers to deliver high quality AI experiences.
• Engineer for reliability and scale, including latency, cost controls, and rate limiting.
• Establish best practices around evaluation, regression detection, and quality gates.
• Contribute to secure AI by design approaches including permissions and prompt injection defenses.
• Mentor junior engineers and contribute to a high ownership team environment.

Requirements

• Strong software engineering skills in distributed systems (Go, Python, or similar).
• Experience building cloud native services using Kubernetes, containers, and CI/CD.
• 4+ years of experience working on a SaaS product or production platform.
• Solid understanding of AI/ML fundamentals including supervised learning, LLM basics, and embeddings/vector search.
• Strong debugging and problem-solving skills for incident-style troubleshooting.
• Passion for building robust, maintainable systems.

Preferred Qualifications

• Hands on experience with AI agents and orchestration frameworks.
• Practical experience with RAG systems, reranking, and grounding.
• Experience with model serving patterns like batch/online inference and streaming.
• Knowledge of security considerations for AI systems such as RBAC and data isolation.
• Familiarity with vector databases.
• Experience with observability stacks and SLO driven engineering.