Data Platform Engineering Lead

Responsibilities

• Support the execution of the target architecture and roadmap for a cloud-native data platform across ingestion, transformation, storage, and governance
• Implement and enhance shared platform capabilities for data ingestion, job orchestration, and metadata management
• Design and optimize Apache Iceberg tables to support reliable performance across compute engines
• Apply engineering standards for CI/CD, IaC, automated testing, and observability
• Partner with Product, Analytics, and ML teams to implement data semantics and product contracts
• Build curated semantic models and deliver governed BI endpoints and consumption APIs
• Lead day-to-day platform operations, including incident response, root-cause analysis, and reliability improvements
• Lead and mentor a team of engineers, driving technical execution and operational discipline

Requirements

• 15+ years in software/data engineering, including technical leadership for large-scale data platforms
• BS/MS in Computer Science, Engineering, or equivalent experience
• Proficiency in writing production-grade Python and SQL
• Experience tuning and troubleshooting Spark for both batch and streaming workloads
• Experience building and operating lakehouse platforms using Snowflake and Databricks on AWS
• Strong communication and stakeholder management skills to influence architecture decisions

Preferred Qualifications

• Prior data platform engineering experience within a financial institution or asset management firm
• Experience working with structured and alternative/unstructured data sources
• Proficiency using AI-assisted coding tools to improve developer productivity

About the Company

State Street is a global leader in investment services, helping institutional investors manage risk, respond to challenges, and drive performance. We are committed to fostering an inclusive environment where employees are empowered to reach their full potential through development opportunities and vibrant employee networks.