Sr. Software System Designer

Responsibilities

• Develop, debug, and optimize end-to-end custom machine learning software solutions for AMD server GPUs
• Position technical proposals and provide support to top customers to ensure PoC success
• Drive custom requirements for AI software performance and stability from PoC to POR release
• Collaborate with cross-functional teams to analyze and optimize training and inference workloads
• Analyze competitive solutions to identify strengths and weaknesses for value propositions
• Apply software engineering best practices to all development efforts

Requirements

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field
• Expertise in machine learning kernel operators (e.g., MHA, MLA, MOE)
• Proficiency in C++ and Python programming
• Hands-on experience with Triton, CUDA, or HIP
• Experience with AI frameworks such as vLLM, Megatron-LM, or similar

Preferred Qualifications

• Experience with model inference optimization (GEMM/convolution tuning, graph optimization, operator fusion)
• Knowledge of compilers such as Torch, Triton, LLVM, or XLA HLO
• Familiarity with Linux ROCm/CUDA runtime and driver environments
• Understanding of AI distributed solutions (EP/SP/CP/TP/PP/DP) and collective communication primitives (NCCL/RCCL)
• Ability to work independently and lead development efforts
• Strong communication skills in both English and Mandarin

About the Company

AMD is a global leader in high-performance computing, graphics, and visualization technologies. Our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers to PCs, gaming, and embedded systems. We strive for execution excellence through a culture of innovation, collaboration, and inclusion.