Senior Machine Learning Test Developer

Responsibilities

• Define ML quality strategy and acceptance criteria across data, model, and system levels
• Design and maintain model evaluation suites, metrics, and test datasets
• Evaluate CAD RL model outputs for geometric validity or policy stability
• Automate ML QA workflows using Python and CI/CD tools like GitHub Actions or Jenkins
• Create and maintain test harnesses for ML services and APIs
• Build quality gates for training and deployment pipelines, including regression checks and drift detection
• Mentor teams on ML QA best practices and consistent evaluation standards
• Participate in code reviews and contribute to multi-team codebases

Requirements

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience
• 7+ years of professional experience in software engineering or QA for ML/AI systems
• Strong programming skills in Python with deep experience in test automation
• Familiarity with popular CAD environments and tooling
• Proficiency with automation and UAT test suites/frameworks
• Strong understanding of software architecture and design patterns
• Ability to work effectively in an agile development environment

Preferred Qualifications

• Experience with data validation tooling (e.g., Great Expectations) or labeling workflows
• Familiarity with ML frameworks such as PyTorch or TensorFlow
• Experience with data pipelines and orchestration tools like Airflow or Metaflow
• Knowledge of MLOps practices, including model monitoring and deployment checks
• Experience with cloud providers (AWS, Azure, or Google Cloud Platform)
• Familiarity with experiment tracking tools like Comet, MLflow, or Weights & Biases

About the Company

Autodesk helps innovators turn their ideas into reality, transforming not only how things are made, but what can be made. From the greenest buildings to the smartest factories, our software empowers creators to shape the world.