Senior HPC & GPU Infrastructure Engineer at Sciforium - ScoutJobs - The AI-curated global job board
Skip to content
S
Posted 6 hours ago

Senior HPC & GPU Infrastructure Engineer

SciforiumSenior HPC & GPU Infrastructure Engineer

Perks & benefits

Medical InsuranceHealth InsurancePaid Leave

Requirements

5+ years HPC/GPU experience, Degree in CS or Engineering, NVIDIA/AMD GPU expertise, Linux internals knowledge, Bash and Python proficiency, ML stack familiarity

Skills

HPCGPULinuxPyTorchCUDAROCm

About the role

About the Company

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD, the team is scaling rapidly to build the full stack powering frontier AI models.

Responsibilities

  • Act as the primary responder for system outages, GPU failures, and cluster-wide incidents
  • Implement monitoring for GPU health, thermal behavior, and PCIe/NVLink topology
  • Coordinate with data center staff and hardware vendors for repairs and RMA processing
  • Install, patch, and maintain Linux distributions and ensure consistent configuration
  • Configure VPNs, firewalls, and network routing to secure infrastructure
  • Lead deployment of new GPU nodes, including BIOS configuration and NUMA tuning
  • Build and optimize kernel modules and maintain GPU drivers for NVIDIA (CUDA) and AMD (ROCm)
  • Maintain and optimize ML frameworks including PyTorch, JAX, and vLLM
  • Troubleshoot complex interactions involving GPUs, compilers, and distributed training runtimes

Requirements

  • 5+ years of experience in HPC, GPU cluster operations, or Linux systems engineering
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or related field
  • Strong expertise with NVIDIA (H100/B200) or AMD (MI325x/MI355x) GPUs
  • Deep understanding of Linux internals, kernel modules, and hardware bring-up
  • Experience with network security, VPNs, and identity management (LDAP/FreeIPA/AD)
  • Proficiency in Bash and Python for automation
  • Familiarity with CUDA toolkit, cuDNN, NCCL, ROCm, and JAX/PyTorch
  • Debugging experience with NVLink/NVSwitch fabrics and RDMA networking

Preferred Qualifications

  • Experience with job schedulers like Slurm, Kubernetes, or Run:AI
  • Exposure to vLLM or model serving optimizations
  • Experience with Ansible, SaltStack, or Terraform
  • Experience supporting ML research teams in a startup environment

Benefits

  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity
ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Senior HPC & GPU Infrastructure Engineer

Sciforium · San Francisco

Sign up to apply