Engineer, Staff-Machine Learning-Embedded, C++

Responsibilities

• Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs
• Act as an AI inferencing expert to push performance limits for large-scale models
• Deploy large C/C++ software stacks using industry best practices
• Stay at the forefront of Generative AI advancements, including LLMs, Transformers, and edge-based deployment nuances

Requirements

• Master's or Bachelor's degree in Computer Science, Engineering, or a related field
• 6+ years of relevant software development experience
• Strong understanding of Generative AI models including LLM, LVM, and LMMs
• Deep knowledge of building blocks such as self-attention, cross-attention, and KV caching
• Proficiency in C/C++ programming, Design Patterns, and OS concepts
• Experience with floating-point, fixed-point representations, and quantization concepts
• Experience optimizing algorithms for AI hardware accelerators (CPU, GPU, or NPU)
• Strong scripting skills in Python and excellent analytical/debugging abilities

Preferred Qualifications

• Strong understanding of SIMD processor architecture and system design
• Proficiency in object-oriented software development
• Familiarity with Linux and Windows environments
• Background in kernel development for SIMD architectures
• Experience with frameworks such as llama.cpp, MLX, or MLC
• Knowledge of PyTorch, TFLite, and ONNX Runtime
• Experience with parallel computing languages like OpenCL or CUDA

About the Company

Qualcomm is a leading technology innovator that pushes the boundaries of what's possible to enable next-generation experiences and drive digital transformation for a smarter, connected future.