S
Posted 6 hours ago
Senior HPC & GPU Infrastructure Engineer
SciforiumSenior HPC & GPU Infrastructure Engineer
Perks & benefits
Medical InsuranceHealth InsurancePaid Leave
Requirements
5+ years HPC/GPU experience, Degree in CS or Engineering, NVIDIA/AMD GPU expertise, Linux internals knowledge, Bash and Python proficiency, ML stack familiarity
Skills
HPCGPULinuxPyTorchCUDAROCm
About the role
About the Company
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD, the team is scaling rapidly to build the full stack powering frontier AI models.
Responsibilities
- Act as the primary responder for system outages, GPU failures, and cluster-wide incidents
- Implement monitoring for GPU health, thermal behavior, and PCIe/NVLink topology
- Coordinate with data center staff and hardware vendors for repairs and RMA processing
- Install, patch, and maintain Linux distributions and ensure consistent configuration
- Configure VPNs, firewalls, and network routing to secure infrastructure
- Lead deployment of new GPU nodes, including BIOS configuration and NUMA tuning
- Build and optimize kernel modules and maintain GPU drivers for NVIDIA (CUDA) and AMD (ROCm)
- Maintain and optimize ML frameworks including PyTorch, JAX, and vLLM
- Troubleshoot complex interactions involving GPUs, compilers, and distributed training runtimes
Requirements
- 5+ years of experience in HPC, GPU cluster operations, or Linux systems engineering
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or related field
- Strong expertise with NVIDIA (H100/B200) or AMD (MI325x/MI355x) GPUs
- Deep understanding of Linux internals, kernel modules, and hardware bring-up
- Experience with network security, VPNs, and identity management (LDAP/FreeIPA/AD)
- Proficiency in Bash and Python for automation
- Familiarity with CUDA toolkit, cuDNN, NCCL, ROCm, and JAX/PyTorch
- Debugging experience with NVLink/NVSwitch fabrics and RDMA networking
Preferred Qualifications
- Experience with job schedulers like Slurm, Kubernetes, or Run:AI
- Exposure to vLLM or model serving optimizations
- Experience with Ansible, SaltStack, or Terraform
- Experience supporting ML research teams in a startup environment
Benefits
- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary and equity
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior HPC & GPU Infrastructure Engineer
Sciforium · San Francisco
