GPU Kernel Engineer

About the Company

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD, the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

Responsibilities

• Design, implement, and optimize custom GPU kernels using C++, PTX, CUDA, ROCm, Triton, and/or JAX Pallas
• Profile and optimize end-to-end performance of ML operations for large-scale LLM training and inference
• Integrate low-level GPU kernels into frameworks such as PyTorch, JAX, and custom internal runtimes
• Develop performance models, identify bottlenecks, and deliver kernel-level improvements
• Collaborate with ML researchers, distributed systems engineers, and model-serving teams
• Work closely with hardware vendors (NVIDIA/AMD) to stay current on GPU architecture and toolchain improvements
• Contribute to tooling, documentation, benchmarking suites, and testing frameworks

Requirements

• 5+ years of industry or research experience in GPU kernel development or high-performance computing
• Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related field
• Strong programming skills in C++ and Python
• Deep expertise in CUDA/ROCm, GPU memory models, and performance optimization
• Hands-on experience with Triton and/or JAX Pallas
• Strong understanding of PTX, GPU ASM, and low-level GPU execution
• Proven ability to integrate kernels into PyTorch or JAX
• Experience working with large-scale LLM workloads

Preferred Qualifications

• Experience with AMD GPUs and ROCm optimization
• Familiarity with JAX FFI and custom ML operator development
• Experience with efficient model serving frameworks like vLLM or TensorRT
• Experience with TPUs, XLA, or similar accelerator programming environments
• Contributions to open-source ML systems, compilers, or GPU kernels

Benefits

• Medical, dental, and vision insurance
• 401k plan
• Daily lunch, snacks, and beverages
• Flexible time off
• Competitive salary and equity