Senior Distributed Machine Learning Engineer

Responsibilities

• Collaborate with researchers to accelerate model research, training, and inference
• Facilitate the use of large-scale models in distributed computing environments
• Investigate performance bottlenecks, profile research code, and debug issues
• Optimize computing resource utilization
• Develop software tools and libraries to orchestrate distributed computing resources
• Establish and maintain best practices for large-scale distributed ML workflows

Requirements

• Degree in Computer Science, Computer Engineering, Software Engineering, or a related field
• 3+ years of experience designing and implementing distributed ML training frameworks
• Recent experience with Megatron, DeepSpeed, HuggingFace Accelerate, FSDP, vLLM, or verl
• Experience with cloud platforms such as AWS, GCP, or Azure
• Experience with workload managers like Ray or SLURM
• Experience with GPU profiling tools like PyTorch profiler, PyProf, or NVIDIA Nsight
• Familiarity with containerization tools like gRPC, Docker, or Kubernetes
• Familiarity with data infrastructure and vector databases
• Proven track record of contributing to high-quality deep learning research projects

Preferred Qualifications

• Graduate degree (Master's or PhD) related to Machine Learning or distributed ML systems

Benefits

• Comprehensive health benefits including mental health and wellness support
• 20 days of vacation per year
• 4% employer contribution to retirement savings
• Additional 8% compensation for retirement savings or bonuses
• Collaborative and inclusive work environment

About the Company

LoiZéro is a non-profit organization dedicated to advancing research and developing technical solutions for safe AI systems. Based in Montreal, LoiZéro conducts research to design non-agentic AI systems that learn to understand the world through transparent probabilistic reasoning, inspired by the work of Professor Yoshua Bengio.