Fellow, AI Workload Optimization

Responsibilities

• Set the technical vision and roadmap for workload optimization across the AI software stack.
• Lead the profiling, analysis, and tuning of large-scale models including LLMs, Diffusion, Multimodal, and MoE.
• Partner with top customers and hyperscalers to deliver tailored architectural wins and software optimizations.
• Collaborate with hardware architecture, compiler, and framework teams to influence future silicon features.
• Drive the development of advanced tools for performance estimation, modeling, and automated reporting.
• Act as a technical ambassador in industry forums and open-source communities while mentoring junior engineers.

Requirements

• 15+ years of software development experience.
• 5+ years in a high-level technical leadership role (Fellow or equivalent).
• Deep expertise in AI Frameworks such as PyTorch, JAX, vLLM, and SGLang.
• Extensive experience with the ROCm software stack.
• Proven history of optimizing distributed inference and training at scale across multi-node/multi-GPU environments.
• Mastery of performance profiling tools (e.g., TorchProfiler, ROCm Profiler, Nsight).
• PhD or Master’s degree in Computer Science, Electrical Engineering, or a related field.

Preferred Qualifications

• Strong understanding of modern model architectures (Transformer, Attention, KV Cache).
• Expertise in optimization techniques like quantization, speculative decoding, and FlashAttention.
• Demonstrated research or applied experience in deep learning, model training/inference optimization, or computer vision.

About the Company

AMD is a global leader in high-performance computing, graphics, and visual computing technologies. Our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers to PCs, gaming, and embedded systems. We strive for execution excellence through a culture of innovation, collaboration, and inclusion.