Senior Production Engineer

Responsibilities

• Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads
• Build automation and reliability tooling to support distributed AI pipelines and inference services
• Define, measure, and improve SLIs/SLOs across AI workloads to ensure performance and reliability targets are met
• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters
• Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services
• Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling
• Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments

Requirements

• Strong software engineering background building production-grade systems
• Demonstrated experience in distributed systems design and implementation
• Hands-on work with large language models (LLMs) or AI/ML infrastructure
• SRE mindset including defining SLIs/SLOs and building observability systems
• Proficiency in Python, Go, Java, or C++
• Familiarity with Kubernetes or container orchestration platforms

Preferred Qualifications

• Experience scaling inference or training workloads for LLMs

Benefits

• Restricted Stock Units
• Health insurance (HDHP, PPO, vision, dental)
• 401(k) with 100% match up to 4%
• Paid Parental Leave
• Paid time off and holiday schedule
• Tuition reimbursement
• Commuter benefit ($300/month)

About the Company

Crusoe is a vertically integrated AI infrastructure company that owns and operates each layer of the stack to power ambitious AI workloads through an energy-first approach.