Senior ML Data Platform Developer

Responsibilities

• Design and maintain a layered storage architecture and partner with the Research team to ensure seamless integration with training pipelines
• Scale and automate the data processing stack to handle petabytes of data
• Ensure efficient use of compute resources, including GPU access for compute-intensive tasks
• Assist the Infrastructure team in provisioning compute and storage environments
• Ensure datasets are versioned, reproducible, and fully traceable in accordance with Data Governance policies
• Develop tooling for dataset exploration, sampling, and analysis to support researcher self-service needs

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, or Software Engineering
• 5+ years of experience in web-scale storage, high-performance networking (HPC), or large-scale distributed ML data frameworks
• Experience with Lustre, Ray, Apache Spark, workflow orchestrators, Apache Arrow, or Parquet
• Experience with workload managers such as Ray, Kubernetes, or SLURM
• Familiarity with containerization tools like Docker or Enroot
• Familiarity with data infrastructures and platforms such as vector databases

Benefits

• Comprehensive health benefits including mental health and wellness management account
• 20 days of vacation per year
• 4% employer contribution to retirement savings
• Additional 8% compensation for retirement savings or bonuses

About the Company

LawZero is a non-profit organization committed to advancing research and creating technical solutions that enable safe-by-design AI systems. Based in Montreal, LawZero’s research aims to build non-agentic AI that learns to understand the world through transparent and externalized probabilistic reasoning.