Technical Program Manager, Platform at Scale AI - ScoutJobs - The AI-curated global job board
Skip to content
Scale AI
Posted 3 days ago

Technical Program Manager, Platform

Scale AITechnical Program Manager, Platform

Requirements

5+ years TPM, PM, or Software Engineering experience, 3+ years managing core engineering infrastructure or cloud-native ecosystems, Foundational understanding of GenAI infrastructure and GPU/CPU clusters, Experience with Kubernetes and AWS/GCP, Proficiency with Linear or Jira

Skills

KubernetesAWSGCPAI/MLDistributed Systems

About the role

Responsibilities

  • Lead strategic planning and high-velocity execution for the Scale Generative AI Platform (SGP) core capabilities, including orchestration layers, model serving, and APIs.
  • Drive cross-functional alignment across systems engineering, Core ML, Research, and Product teams to ensure architectural consistency.
  • Translate complex infrastructure metrics, such as LLM inference optimization and GPU utilization, into actionable product roadmaps.
  • Proactively identify and mitigate technical risks unique to massive-scale GenAI infrastructure and global deployments.
  • Establish agile processes and define clear SLOs to ensure production-grade reliability and developer velocity.
  • Track and report on platform adoption metrics and system reliability to executive leadership.

Requirements

  • 5+ years of experience as a Technical Program Manager, Product Manager, or Software Engineer, with a track record of shipping technical platforms or distributed systems.
  • 3+ years of experience managing core engineering infrastructure or cloud-native ecosystems (AWS/GCP).
  • Foundational understanding of GenAI infrastructure, including GPU/CPU cluster utilization and high-throughput data pipelines.
  • Hands-on experience with Kubernetes and container orchestration.
  • Proficiency with modern project management tools such as Linear or Jira.
  • Strong communication skills with the ability to influence executive-level stakeholders.

Preferred Qualifications

  • Prior professional experience as a Software Engineer, DevOps Engineer, or Data Developer.
  • Proven success driving the internal adoption of technical platforms, SDKs, or APIs.
  • Experience with large-scale data quality pipelines, distributed vector databases, or AI inference engines like Triton or Ray.

About the Company

Scale AI is developing reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, helping enterprises and governments build, deploy, and oversee AI applications that deliver real impact.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Technical Program Manager, Platform

Scale AI · London

Sign up to apply