AI SW Stack Deployment Architect

Responsibilities

• Architect integration of vLLM, PyTorch, TensorFlow, and JAX/XLA into the Next Generation Accelerator stack
• Define framework, compiler, and runtime APIs and contracts
• Own LLM execution behavior including batching, KV cache, and streaming inference
• Design and implement end-to-end deployment workflows for packaging, versioning, and reproducibility
• Drive performance optimization across the model, framework, and runtime layers
• Work cross-functionally with compiler, runtime, and low-level software teams
• Support customer workloads, model onboarding, and debugging

Requirements

• 10+ years in AI/ML systems or software architecture
• Strong experience with PyTorch, Transformers, and LLMs
• Hands-on experience with LLM deployment and scalable inference engine systems (e.g., vLLM, Triton, SGLang)
• Experience building scalable AI platforms for cloud or edge environments
• Expertise in system design, APIs, and cross-layer integration

Preferred Qualifications

• Experience with vLLM or similar LLM serving systems
• Familiarity with XLA, MLIR, or compiler frameworks
• Exposure to AI accelerators (GPU/NPU) and runtime systems
• Experience in distributed or multi-agent AI systems

About the Company

Sandisk understands how people and businesses consume data and relentlessly innovates to deliver solutions that enable today’s needs and tomorrow’s next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world.