Senior Data Engineer

Responsibilities

• Build and operate end-to-end batch and streaming data pipelines on lakehouse platforms including Snowflake, Databricks, and Apache Spark
• Develop production-grade pipeline code using Python, SQL, and Java/Scala, ensuring reliability and performance
• Implement and maintain Apache Iceberg tables, including partitioning, schema evolution, and metadata management
• Deliver governed data integration and curation for reference and application domains
• Implement automated data quality, validation, reconciliation, lineage, and observability
• Partner with domain SMEs and architects to implement logical and physical data models
• Use CI/CD pipelines and platform tooling to deploy and run data workloads
• Troubleshoot data and environment issues through root-cause analysis and corrective actions
• Support incident management and maintain production stability for data pipelines

Requirements

• 10+ years of experience in software and/or data engineering
• Strong programming skills in Python and SQL
• Hands-on experience with Apache Spark (batch and/or streaming)
• Hands-on experience with Snowflake and Databricks in an enterprise environment
• Experience building production-grade data pipelines in cloud environments (AWS preferred)
• Solid understanding of data modeling, ETL/ELT patterns, and distributed data processing
• Experience in Capital Markets with knowledge of key reference and application domains
• Excellent written and verbal communication skills

Preferred Qualifications

• Experience with data quality frameworks, automated reconciliation patterns, and data lineage tooling
• Professional Certificates in Snowflake and/or Databricks
• Professional Certificates in AWS, GCP, or Azure

About the Company

State Street is a global leader in investment management, helping institutional investors manage risk, respond to challenges, and drive performance. We are committed to fostering an inclusive environment where employees are empowered to reach their full potential through development opportunities and flexible work-life support.