Staff Machine Learning Tools Engineer

Responsibilities

• Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs
• Act as an AI inferencing expert to push performance limits for large-scale models
• Deploy large C/C++ software stacks using industry best practices
• Stay at the forefront of Generative AI advancements, including LLMs, Transformers, and edge-based deployment nuances

Requirements

• Master's or Bachelor's degree in Computer Science, Engineering, or a related field
• 6+ years of relevant software development experience
• Strong understanding of Generative AI models (LLM, LVM, LMMs) and building blocks like self-attention, cross-attention, and KV caching
• Deep knowledge of floating-point, fixed-point representations, and quantization concepts
• Proven experience optimizing algorithms for AI hardware accelerators (CPU, GPU, or NPU)
• Proficiency in C/C++ programming, Design Patterns, and OS concepts
• Strong scripting skills in Python
• Excellent analytical, debugging, and communication skills

Preferred Qualifications

• Strong understanding of SIMD processor architecture and system design
• Proficiency in object-oriented software development
• Familiarity with Linux and Windows environments
• Background in kernel development for SIMD architectures
• Experience with frameworks such as llama.cpp, MLX, and MLC
• Knowledge of PyTorch, TFLite, and ONNX Runtime
• Experience with parallel computing languages like OpenCL and CUDA

About the Company

Qualcomm is a leading technology innovator that pushes the boundaries of what's possible to enable next-generation experiences and drive digital transformation for a smarter, connected future.