Lead Data Platform Engineer

Responsibilities

• Co-own and evolve the overall data platform architecture across all domains
• Guide the technical vision for the entire Data Engineering organization
• Design and drive implementation of highly scalable platform architectures for multi-TB+ daily workloads
• Author and sign off on all RFCs and technical specifications
• Build self-service infrastructure and design event-driven, real-time data architectures using Kafka
• Architect comprehensive Infrastructure as Code strategies and GitOps frameworks
• Mentor senior engineers and collaborate across the Engineering organization
• Lead complex incident response and establish SLAs/SLOs for critical services

Requirements

• 10-15+ years of professional experience in data platform engineering
• Expert-level proficiency in SQL, Python, and at least one additional programming language
• Deep expertise with databases including PostgreSQL, MySQL, Snowflake, Oracle, DynamoDB, and MongoDB
• Extensive Kafka ecosystem expertise (cluster management, Debezium, schema registry, Connect)
• Advanced container orchestration with Kubernetes and Docker at scale
• Proven track record architecting platforms processing multi-TB daily workloads
• Mastery of data orchestration platforms like Airflow, Prefect, or Dagster
• Experience with both modern and legacy technologies (Oracle, SQL Server, Informatica, SSIS)

Preferred Qualifications

• Experience with modern data stack tools like dbt and Looker
• Machine learning infrastructure and MLOps architecture expertise
• Contributions to open-source data infrastructure projects
• Expert knowledge of data privacy frameworks like GDPR and CCPA

About the Company

We are transforming our legacy infrastructure into a modern cloud-first platform and seeking a leader to shape the strategic direction and architecture of our data infrastructure.