HPC Specialist

Responsibilities

• Deploy, maintain, and optimize GPU infrastructure for large-scale LLM inference workloads
• Architect and implement distributed serving solutions for multi-node, multi-GPU model deployments
• Manage GPU-enabled Kubernetes clusters for LLM and ML workloads
• Configure network infrastructure including load balancers, firewalls, and inter-node communication
• Implement and optimize storage solutions for model weights and inference caches
• Troubleshoot performance bottlenecks across hardware, drivers, networking, and application layers
• Research and evaluate emerging GPU technologies and model serving frameworks
• Collaborate with ML engineers to profile model performance and implement inference acceleration
• Drive reliability improvements through monitoring, alerting, and capacity planning

Requirements

• Bachelor's or Master's degree in Computer Science, Systems Engineering, or related field
• 5+ years in DevOps, SRE, or infrastructure engineering roles
• Strong experience with GPU infrastructure, model serving frameworks (vLLM, SGLang), and GPU driver management
• Hands-on experience optimizing deep learning workloads on GPU clusters
• Deep Linux systems knowledge including network configuration, storage optimization, and Kubernetes orchestration
• Experience with infrastructure as code tools like Ansible or Terraform
• Strong understanding of distributed systems, networking protocols, and load balancing
• Proficiency in Python and Bash scripting
• Experience with monitoring and observability tools like Prometheus or Grafana

About the Company

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world.