Software Architect

About the Company

SambaNova is disrupting the AI and high-performance computing space with an integrated hardware and software platform. Their SambaStack inference serving platform pushes the boundaries of inference serving for generative AI and large language models.

Responsibilities

• Own the end-to-end technical architecture of the SambaStack inference platform
• Define and drive architectural strategy across engineering teams
• Lead design reviews for major new capabilities and cross-cutting system changes
• Proactively identify and resolve systemic risks, including performance bottlenecks and scaling constraints
• Establish and evolve architectural standards, patterns, and best practices
• Partner with ML Engineers, Product Managers, QA, and DevOps to translate requirements into architectural decisions
• Serve as a technical thought leader and mentor to Software Engineers
• Evaluate emerging technologies and industry trends to inform the technical roadmap
• Architect new systems and components to solve problems in the AI inference space

Requirements

• 12+ years of software engineering experience
• Proven track record of owning large-scale distributed systems architectures
• Expertise building backend systems in Python, Go, or Rust
• Expert-level understanding of Kubernetes, including Operators and Helm Charts
• Strong command of distributed systems principles: consistency, fault tolerance, and observability
• Demonstrated experience setting technical direction across multiple teams
• Excellent written and verbal communication skills
• Track record of mentoring junior engineers

Preferred Qualifications

• Deep familiarity with AI inference serving and LLM workloads
• Experience designing systems for custom hardware accelerators (GPUs, TPUs, etc.)
• Background in ML application optimization and productionization
• Experience building cloud-native platforms for enterprise customers
• Experience at a high-growth AI infrastructure company