Lead Software Engineer, Model Serving Platform

About the Company

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD, the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

Responsibilities

• Lead the technical direction of the model serving platform and own architecture decisions
• Build core serving components including execution runtimes, batching, scheduling, and distributed inference systems
• Develop high-performance C++ and CUDA/HIP modules, including custom GPU kernels
• Collaborate with ML researchers to productionize new multimodal models
• Build Python APIs and services that expose model capabilities to downstream applications
• Mentor and support other engineers through code reviews and design discussions
• Drive performance profiling, benchmarking, and observability across the inference stack

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
• 5+ years of experience designing and building scalable backend systems or distributed infrastructure
• Strong understanding of LLM inference mechanics (prefill vs decode, batching, KV cache)
• Experience with Kubernetes, Ray, and containerization
• Strong proficiency in C++ and Python
• Strong debugging, profiling, and performance optimization skills at the system level
• Ability to lead technical discussions and mentor engineers
• Ability to work from the office in San Francisco

Preferred Qualifications

• Experience with ML systems engineering or distributed GPU scheduling
• Experience with open source inference engines like vLLM, Sglang, or TRT-LLM
• Proficiency in CUDA or ROCm and experience with GPU profiling tools
• Experience at an AI/ML startup, research lab, or Big Tech infrastructure team
• Familiarity with multimodal model architectures or efficient inference techniques
• Contributions to open-source ML or HPC infrastructure

Benefits

• Medical, dental, and vision insurance
• 401k plan
• Daily lunch, snacks, and beverages
• Flexible time off
• Competitive salary and equity