Member of Technical Staff - Infrastructure

About the Company

Gimlet is building the next generation of AI infrastructure: large-scale AI datacenters and the orchestration platform that coordinates them. The platform intelligently partitions and routes workloads across heterogeneous hardware, enabling step-function improvements in performance and efficiency.

Responsibilities

• Design, deploy, and operate large-scale CPU, GPU, and accelerator clusters powering production AI inference.
• Build automation for provisioning, configuration, upgrades, validation, and lifecycle management.
• Design and scale provisioning systems for heterogeneous bare-metal infrastructure across multiple datacenters and hardware vendors.
• Operate cluster scheduling, resource allocation, isolation, quotas, and utilization systems.
• Debug complex production issues across Linux, networking, storage, drivers, firmware, and orchestration layers.
• Build and operate high-performance networking infrastructure, including RDMA-enabled environments and accelerator interconnects.
• Build observability for cluster health, capacity, performance, failures, and workload behavior.
• Improve reliability, availability, and recovery across multi-node production systems.
• Evaluate and integrate new hardware platforms, accelerators, and networking technologies.

Requirements

• Experience in infrastructure, cluster engineering, platform engineering, SRE, HPC, or distributed systems.
• Deep Linux systems experience, including debugging performance, networking, storage, and kernel-level issues.
• Experience operating Kubernetes, Slurm, Nomad, or similar orchestration and scheduling systems.
• Strong automation skills using tools such as Terraform, Ansible, Helm, Python, or Go.
• Experience with GPU or accelerator infrastructure, including drivers, firmware, or CUDA/ROCm stacks.
• Familiarity with high-performance networking such as InfiniBand, RoCE, or high-speed Ethernet.
• Comfort working in a fast-moving startup environment with high ownership.

Preferred Qualifications

• Experience building or operating AI inference, training, HPC, or neocloud infrastructure.
• Experience with bare-metal provisioning, PXE/iPXE, or BIOS/firmware management.
• Experience with multi-tenant cluster isolation, quota systems, or fair scheduling.
• Experience building observability platforms using Prometheus, OpenTelemetry, or Grafana.
• Familiarity with heterogeneous hardware environments across NVIDIA, AMD, Intel, or ARM.