Member of Technical Staff, ML Systems

Responsibilities

• Prototype and optimize emerging ML inference systems
• Develop novel memory models for expandable vRAM
• Write efficient GPU kernels for data movement
• Perform design-space exploration, implementation, and benchmarking of inference engines in simulations and on real hardware
• Guide the hardware team on product definition

Requirements

• MS or PhD in computer systems
• Focus on LLM inference and/or distributed systems
• Experience contributing to core LLM inference infrastructures such as vLLM, SGLang, or TensorRT
• Experience in accelerator programming (CUDA, JAX/Pallas, or ROCm)

Preferred Qualifications

• Advanced computer architectures knowledge
• Performance engineering skills

Benefits

• Competitive salary and incentive-based bonus
• Early stage equity grant
• Comprehensive health, dental, vision, and life insurance
• Relocation assistance and visa sponsorship
• Daily lunch stipend and 401k match