Senior AI Serving Engineer, Backend

About the Company

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD, the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

Responsibilities

• Build the model serving platform, including API, Control Plane, Billing, Monitoring, and distributed inference features
• Collaborate with ML researchers to integrate new multimodal models into production workflows
• Write reliable, maintainable code with strong testing and documentation practices
• Provide operational support for keeping production services highly performant, available, and reliable
• Help troubleshoot complex issues across runtime, service, and GPU layers

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field
• 3+ years of software engineering experience focused on infrastructure or machine learning systems
• Strong proficiency in C++, Python, Go, or Rust
• Experience with Kubernetes and containerization
• Experience in building large scale ML/MLOps infrastructure
• Ability to work from the office in San Francisco

Preferred Qualifications

• Experience with ML systems engineering or open source inference engines like vLLM, Sglang, or TRT-LLM
• Proficiency in CUDA or ROCm and experience with GPU profiling tools
• Contributions to open-source ML or HPC infrastructure

Benefits

• Medical, dental, and vision insurance
• 401k plan
• Daily lunch, snacks, and beverages
• Flexible time off
• Competitive salary and equity