Senior Site Reliability Engineer

Responsibilities

• Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments
• Optimize control plane components for large-scale, distributed AI/ML workloads
• Build intelligent scheduling and resource management systems for heterogeneous compute clusters
• Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
• Support and optimize accelerator integration, including GPUs and TPUs
• Handle container image management and dependency resolution for distributed workloads
• Participate in code reviews, design discussions, and provide on-call support to troubleshoot infrastructure issues

Requirements

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
• 3+ years of experience writing high-quality production code
• Hands-on experience building and maintaining highly available, scalable, and performant distributed systems
• Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
• Proficiency in Go and Python
• Knowledge of low-level operating system foundations, including the Linux kernel, file systems, and containers
• Deep understanding of networking, security, and authentication mechanisms in cloud environments

Preferred Qualifications

• Familiarity with observability stacks such as Prometheus and Grafana
• Experience with both VM-based and Kubernetes-based deployments

About the Company

Anyscale is on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We are commercializing Ray, a popular open-source project that creates an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, and Spotify use Ray to accelerate the progress of AI applications.