Director, Data Platform Engineering at Lila Sciences - ScoutJobs - The AI-curated global job board
Skip to content
L
Posted 19 hours ago

Director, Data Platform Engineering

Lila SciencesDirector, Data Platform Engineering

Requirements

12+ years software development, 5+ years engineering leadership, Petabyte scale data platform experience, Python proficiency, AWS/GCP experience, Kubernetes experience

Skills

PythonAWSKubernetes

About the role

Responsibilities

  • Build, mentor, and manage a high-performing team of 8-12 data engineering experts
  • Define and execute the technical roadmap for the data platform
  • Drive innovation in Data Lakehouse and data serving ecosystems
  • Ensure reliability, availability, and security of data processing infrastructure
  • Partner with data scientists, lab scientists, and product managers to understand data needs
  • Represent Lila’s data platform work at external conferences and through technical writing
  • Drive innovative, agentic, and low-code solutions for data interfaces and ML/inference workflows

Requirements

  • 12+ years of software development experience with a focus on large-scale data processing
  • 5+ years of experience leading senior engineers
  • Experience building on AWS/GCP primitives (S3, Athena, BigQuery)
  • Experience operating data platforms at petabyte scale with sub-second query latency
  • Experience managing infrastructure for 100+ concurrent ML training and inference workloads
  • Familiarity with LLM/AI-native data patterns including vector stores and embedding pipelines
  • Hands-on coding proficiency in Python and modern backend frameworks
  • Experience with infrastructure-as-code and Kubernetes
  • BS, MS, or Ph.D. in Computer Science or a related field

Preferred Qualifications

  • Thought leadership via conference presentations or blog posts
  • Experience growing teams focused on open source technologies
  • Experience in scientific data management and quality
  • Experience building self-service data products where developer experience is a priority

About the Company

Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges. LILA combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science that executes the entire scientific method autonomously.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Director, Data Platform Engineering

Lila Sciences · San Francisco

Sign up to apply