Member of Technical Staff, Performance and Scale

About the Company

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware.

Responsibilities

• Build the distributed systems that power inference at global scale
• Design and implement foundational layers to enable vLLM to serve models across thousands of accelerators
• Minimize latency and maximize reliability for frontier model deployment

Requirements

• Bachelor's degree or equivalent experience in computer science or engineering
• Strong systems programming skills in Rust, Go, or C++
• Experience designing and building high-performance distributed systems at scale
• Understanding of network protocols and high-performance I/O
• Ability to debug complex distributed systems issues

Preferred Qualifications

• Experience with ML serving infrastructure and disaggregated inference architecture
• Familiarity with GPU programming models and memory hierarchies
• Knowledge of GPU interconnects such as NVLink, InfiniBand, or RoCE
• Track record of improving system reliability and performance at scale

Benefits

• Annual salary range of S$200,000 to S$400,000 plus equity
• Medical, dental, and vision coverage
• Visa sponsorship available on a case-by-case basis