Member of Technical Staff, Cloud Infrastructure

About the Company

Fireworks is a Series C company valued at $4 billion, building the future of generative AI infrastructure. Our platform delivers high-quality models with industry-leading inference speed, backed by top investors like Benchmark and Sequoia.

Responsibilities

• Architect and build scalable, resilient backend infrastructure for distributed training, inference, and data processing
• Design and implement core backend services including job schedulers, resource managers, and model serving layers
• Lead technical design discussions and mentor other engineers
• Drive infrastructure optimization for compute cost reduction and network performance
• Collaborate with ML, DevOps, and product teams to translate research into robust solutions
• Ensure system reliability, fault tolerance, and high availability across multi-cloud environments
• Develop and maintain comprehensive monitoring, alerting, and observability solutions

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field
• 5+ years of experience building backend infrastructure in cloud environments (AWS, GCP, or Azure)
• Proven experience in ML infrastructure and tooling (PyTorch, TensorFlow, Kubernetes, etc.)
• Strong software development skills in Python or C++
• Deep understanding of distributed systems fundamentals including scheduling, orchestration, and networking

Preferred Qualifications

• Master’s or PhD in Computer Science or a related field
• Experience leading infrastructure projects for large-scale ML/AI workloads
• Familiarity with infrastructure-as-code and CI/CD (Terraform, ArgoCD, GitOps)
• Contributions to open-source cloud or ML infrastructure projects