Senior GPU Infrastructure Engineer

About the Company

Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By aggregating computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that promise affordability and accessibility for all.

Responsibilities

• Build and scale Hyperbolic's GPU Cloud Marketplace by building a multi-tenancy provisioning and virtualization solution
• Transform raw GPUs from diverse global suppliers into a programmable, orchestrated pool
• Build the core orchestration layer to enable cost savings compared to traditional cloud providers

Requirements

• Deep understanding of bare-metal provisioning and lifecycle management (IPMI/Redfish, BMC, PXE boot)
• Deep understanding of GPU scheduling and orchestration (memory management, topology, placement strategies)
• Strong infrastructure and DevOps skills with Terraform or Pulumi
• Experience with storage and data infrastructure for AI/ML workloads
• Proficiency with API design and cloud-init
• Solid understanding of GPU architecture, CUDA, and GPU compute optimization
• Experience building and scaling cloud infrastructure or distributed systems in production

Preferred Qualifications

• Familiarity with high-performance networking technologies such as InfiniBand and RoCE
• Experience with distributed storage systems such as Ceph, Weka, or VAST Data