Machine Learning Infra Engineer

About the Company

Reducto is the agentic document platform for leading AI teams who demand enterprise performance at scale. We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading frontier models to power efficient and accurate document workflows.

Responsibilities

• Build and maintain the training and inference stack with an emphasis on fast iteration and high performance
• Develop benchmarks for both sets of stacks to identify bottlenecks
• Explore SOTA advances in training and inference and work to apply them
• Design systems for scaling model training across multi-node, multi-GPU environments
• Scale distributed training and inference workloads across large GPU clusters
• Build tooling, abstractions, and observability to help ML engineers move from experiment to production

Requirements

• 3+ years of experience
• Strong Python skills
• Background in systems engineering
• Proficiency with Kubernetes and distributed training frameworks
• Ability to work in a fast-changing, high-growth environment

Preferred Qualifications

• Experience at an early-stage or high-growth startup
• Meaningful contributions to open source training/inference stacks
• Interest in setting up distributed inference across 100s-1000s of GPUs

Benefits

• Unlimited PTO
• Daily free lunch in the office
• Reimbursed transportation costs
• Generous health, dental, and vision insurance
• $150/mo health and wellness budget
• Parental leave