Software Engineer

Responsibilities

• Build and evolve backend services for agent orchestration, tool execution, and RAG pipelines
• Design APIs and control plane workflows for secure, tenant-aware AI platform components
• Implement MCP style tool discovery and integration patterns
• Engineer for reliability, scale, latency, and cost controls
• Establish best practices for evaluation, including regression detection and prompt tracking
• Contribute to secure AI design, including prompt injection defenses and data access boundaries
• Mentor junior engineers and contribute to a high ownership team environment

Requirements

• 4+ years of experience working on a SaaS product or production platform
• Strong software engineering skills in Go, Python, or similar distributed systems languages
• Experience building cloud native services using Kubernetes, containers, and CI/CD
• Solid understanding of AI/ML fundamentals including supervised learning, LLM basics, and vector search
• Strong debugging and problem-solving skills for service and infrastructure troubleshooting

Preferred Qualifications

• Hands on experience with AI agents and orchestration frameworks
• Practical experience with RAG systems, reranking, and grounding
• Experience with model serving patterns like batch/online inference and streaming
• Knowledge of security considerations for AI systems such as RBAC and prompt injection
• Familiarity with vector databases and observability stacks

About the Company

SingleStore delivers a cloud-native distributed SQL database that unifies transactions and analytics to power data-intensive applications. The company is venture-backed and headquartered in San Francisco with global offices.