Inference Engine Development - Member of Technical Staff

About the Company

Callosum is the Intelligent Systems Company. We believe intelligence emerges from the diversity of co-optimised mechanisms working together. We co-evolve models, workflows, and silicon to build the infrastructure for the next era of heterogeneous AI.

Responsibilities

• Contribute upstream to SGLang and vLLM, and maintain internal forks where requirements diverge
• Improve hardware-awareness within inference engines for scheduling, memory management, and execution
• Design and implement bespoke parallelism and disaggregation strategies to exploit heterogeneous hardware
• Work closely with Accelerator Systems Software engineers to map engine-level abstractions to diverse hardware

Requirements

• Deep familiarity with SGLang, vLLM, or comparable inference serving frameworks
• Strong background in high-performance Python and C++/CUDA systems
• Experience designing or implementing parallelism strategies for large model serving
• Understanding of disaggregated serving architectures and associated tradeoffs
• Experience working effectively in fast-moving open source codebases

Benefits

• Competitive Salary
• Equity & Ownership
• Private healthcare
• Visa sponsorship and relocation benefits