Rust Engineer

Responsibilities

• Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout
• Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic
• Design and execute a gradual rollout that holds stability as the top constraint
• Restructure the existing codebase to position it for a clean, incremental move to Rust
• Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo
• Collaborate cross-functionally to ensure migration aligns with backend priorities

Requirements

• Deep, long-standing expertise in Rust
• Obsessive focus on performance, latency, and throughput
• Strong instinct for system stability and reliability
• Familiarity with backend infrastructure, PostgreSQL, and Redis
• Experience with high-volume production systems

Preferred Qualifications

• Prior experience leading codebase migrations from another language to Rust
• Demonstrated history of shipping performance-critical systems

Benefits

• Competitive salary
• Health, dental, and vision benefits

About the Company

LiteLLM is the world's most popular AI Gateway, providing secure, reliable access to LLMs and adjacent services for companies like Adobe, Netflix, and NASA.