AI Infrastructure Engineer

Responsibilities

• Operate and optimize GPU clusters using Kubernetes, Slurm, and Ray across multiple regions
• Implement elastic scheduling and unified orchestration for inference and training jobs
• Manage and tune vLLM / SGLang runtimes for high-throughput, low-latency serving
• Optimize distributed scheduling for multi-replica, multi-tenant serving
• Benchmark and profile performance across workloads and model sizes
• Tune distributed communication stacks including NCCL, RCCL, RDMA, and InfiniBand
• Build observability with Prometheus, Grafana, and Ray Dashboard

Requirements

• Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field
• 3-5+ years in ML Infrastructure, HPC, or Systems Engineering
• Hands-on experience with Kubernetes, Slurm, or Ray
• Familiarity with vLLM, SGLang, or similar inference frameworks
• Strong background in PyTorch, JAX, distributed systems, and communication stacks
• Proficiency in Python plus one of Go, C++, or Rust
• Experience building observability with Prometheus and Grafana
• Fluent in English

Preferred Qualifications

• PhD in a related field
• Experience with major cloud platforms and designing large-scale production-grade architectures

About the Company

Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud, providing comprehensive computing solutions across the value chain including ASIC chip design, datacenter construction, and advanced cloud capabilities.