Senior Software Engineer, NCCL

Responsibilities

• Design, implement, and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g., NCCL for TensorFlow/PyTorch) and HPC programming interfaces (e.g., UCX for MPI/OpenSHMEM) on GPU clusters.
• Participate in and contribute to parallel programming interface specifications such as MPI and OpenSHMEM.
• Design and maintain system software that enables seamless interactions among GPUs and between GPUs and other system components.
• Create proof-of-concepts to evaluate and motivate extensions in programming models, new runtime designs, and new hardware features.

Requirements

• M.S. or Ph.D. in Computer Science, Computer Engineering, or an equivalent field.
• 5+ years of relevant professional experience.
• Excellent C/C++ programming and debugging skills.
• Strong experience working within Linux environments.
• Expert understanding of computer system architecture and operating systems.
• Experience with parallel programming interfaces and communication runtimes.
• Ability to work effectively in a multi-national, multi-time-zone corporate environment.

Preferred Qualifications

• Deep understanding of technology and a passion for high-performance computing.
• Experience with CUDA programming and NVIDIA GPUs.
• Knowledge of high-performance networks such as InfiniBand or iWARP.
• Experience with HPC applications.
• Experience with Deep Learning Frameworks like PyTorch or TensorFlow.
• Strong collaborative and interpersonal skills with the ability to influence within a dynamic matrix environment.

About the Company

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing, and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.