Senior ML Architect

Responsibilities

• Architect end-to-end ML architectures for multi-agent systems in regulated industries like finance and healthcare
• Build scalable inference infrastructure and MLOps pipelines using Kubeflow, MLflow, Ray, and Karpenter on Amazon EKS
• Lead technical design for AI accelerator features, including distributed compute orchestration and multi-tenant isolation
• Architect voice AI systems with real-time STT/TTS, contextual memory, and post-call analytics
• Partner with enterprise customers to conduct architecture reviews and Proof of Concepts (POCs)
• Mentor ML engineers on agentic design patterns, production ML, and cloud-native AI infrastructure
• Drive internal R&D by experimenting with frontier models and emerging agent orchestration frameworks

Requirements

• 8+ years of experience building production ML systems, with at least 3 years architecting at scale
• Deep hands-on experience with GPU scheduling, autoscaling, and distributed frameworks like Ray or Kubeflow
• Strong foundation in LLM architectures, RAG pipelines, and model serving (vLLM, Triton, or SageMaker)
• Proficiency in Python and ML frameworks such as PyTorch, TensorFlow, or HuggingFace
• Extensive experience with cloud-native architectures on AWS (EKS, SageMaker, Bedrock, Lambda)
• Understanding of agentic AI patterns, including multi-agent orchestration and tool use/function calling
• Experience with MLOps tooling for experiment tracking, feature stores, and CI/CD for ML

Preferred Qualifications

• Knowledge of voice AI technologies including WebRTC and real-time streaming
• Experience implementing governance frameworks for regulated AI environments
• Ability to translate complex technical decisions into ROI narratives for business leaders

Benefits

• Learn from experts, including former AWS leaders and AI pioneers
• Direct ownership of high-impact "greenfield" projects from concept to global launch
• Opportunity to master the latest Generative AI frameworks and cloud-native architectures
• Work on mission-critical systems used by major global enterprises
• Rapid career growth in a high-speed environment

About the Company

Aivar Innovations is an AI-first technology partner where cutting-edge technology meets industry expertise. We build AI-augmented teams that accelerate development, reduce time-to-market, and deliver scalable, repeatable solutions for global businesses.