Member of Technical Staff, Performance Optimization

Responsibilities

• Optimize system and GPU performance for high-throughput AI workloads across training and inference
• Analyze and improve latency, throughput, memory usage, and compute efficiency
• Profile system performance to detect and resolve GPU- and kernel-level bottlenecks
• Implement low-level optimizations using CUDA, Triton, and other performance tooling
• Drive improvements in execution speed and resource utilization for large-scale model workloads
• Collaborate with ML researchers to co-design and tune model architectures for hardware efficiency
• Improve support for mixed precision, quantization, and model graph optimization
• Build and maintain performance benchmarking and monitoring infrastructure
• Scale inference and training systems across multi-GPU, multi-node environments

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
• 5+ years of experience in performance optimization or high-performance computing systems
• Proficiency in CUDA or ROCm
• Experience with GPU profiling tools such as Nsight, nvprof, or CUPTI
• Familiarity with PyTorch and performance-critical model execution
• Experience with distributed system debugging and optimization in multi-GPU environments
• Deep understanding of GPU architecture, parallel programming models, and compute kernels

Preferred Qualifications

• Master’s or PhD in Computer Science, Electrical Engineering, or a related field
• Experience optimizing large models for training and inference (LLMs, VLMs, or video models)
• Knowledge of compiler stacks or ML compilers like torch.compile, Triton, or XLA
• Contributions to open-source ML or HPC infrastructure
• Familiarity with cloud-scale AI infrastructure and orchestration tools like Kubernetes
• Background in ML systems engineering or hardware-aware model design

About the Company

Fireworks is building the future of generative AI infrastructure, delivering high-quality models with the fastest and most scalable inference in the industry. A Series C company valued at $4 billion, Fireworks is an ambitious team of builders founded by veterans of Meta PyTorch and Google Vertex AI.