Member of Technical Staff, Cloud Orchestration

About the Company

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware.

Responsibilities

• Build the operational backbone that keeps vLLM running reliably at massive scale
• Design systems for cluster management, deployment automation, and production monitoring
• Ensure vLLM deployments are observable, debuggable, and recoverable
• Turn operational complexity into infrastructure that just works

Requirements

• Bachelor's degree or equivalent experience in computer science or engineering
• Strong experience with Kubernetes and container orchestration at scale
• Experience designing and implementing custom Kubernetes operators
• Proficiency in Python, Rust, or Go
• Experience with infrastructure-as-code tools like Terraform or Helm
• Experience managing GPU clusters and debugging hardware issues
• Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure

Preferred Qualifications

• Experience with ML-specific orchestration tools such as Ray or Slurm
• Knowledge of GPU scheduling, multi-tenancy, and resource optimization
• Familiarity with vLLM deployment patterns and configuration
• Track record of improving operational reliability for ML systems
• Experience deploying inference systems on large-scale GPU (1,000+) clusters