SDE IV - GPU Engineer

Responsibilities

• Architect high-performance inference runtimes, kernel dispatchers, and memory planners for large diffusion and transformer workloads
• Lead investigations into cross-GPU performance bottlenecks, communication overheads, and scheduling inefficiencies
• Drive multi-GPU parallelism strategies including model, pipeline, and tensor parallelization
• Establish company-wide GPU optimization standards, tooling, and SLIs
• Collaborate with research to design scalable implementations of novel architectures
• Mentor engineers in profiling, tuning, and low-level optimization
• Partner with hardware vendors and infra teams to maximize cluster utilization

Requirements

• 5+ years in high-performance computing, GPU runtime systems, or ML infrastructure
• Proven expertise in CUDA, Triton, and C++
• Deep understanding of GPU scheduling, occupancy, register usage, and tensor cores
• Experience building and maintaining distributed inference or training systems
• Ability to design abstractions balancing flexibility and performance
• Strong knowledge of NCCL, NVLink, PCIe, and interconnects
• Familiarity with profiling automation and performance dashboards
• Excellent technical leadership and mentoring capabilities

Preferred Qualifications

• Background in compiler-aided optimization (TVM, XLA, MLIR, Triton)
• Experience tuning Stable Diffusion or transformer inference pipelines
• Exposure to heterogeneous compute backends (AMD ROCm, TPU, ASICs)
• Experience working with hardware–software co-design initiatives
• Open-source or research contributions in GPU optimization

About the Company

Glance AI is an AI commerce platform shaping the next wave of e-commerce with inspiration-led shopping. Operating in 140 countries, Glance AI transforms every screen into a stage for instant, personal, and joyful discovery. Part of the InMobi Group, Glance AI is backed by Google, Jio Platforms, and Mithril Capital.