Software Engineer - Kernels/CUDA

Responsibilities

• Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads
• Develop and tune low-level CUDA kernels (GeMM, Attention, etc.) using CUTLASS, Tensor Cores, and Nsight
• Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operation
• Collaborate closely with AI research teams to deliver production-grade performance and scalability

Requirements

• Deep low-level systems programming in C/C++/PTX/SASS
• Strong experience with large-scale GPU clusters or distributed compute infrastructure at production scale
• Hands-on GPU kernel optimization with CUTLASS, custom kernels, and Nsight profiling
• Track record of building or running high-performance infrastructure for AI workloads
• Ability to reason from first principles and optimize for memory-bound and compute-bound scenarios

Benefits

• Base salary plus equity
• Comprehensive medical, vision, and dental coverage
• 401(k) retirement plan access
• Short and long-term disability insurance
• Life insurance and various other discounts and perks

About the Company

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. The team is small, highly motivated, and focused on engineering excellence, operating with a flat organizational structure where all employees contribute directly to the mission.