Senior Data Engineer at State Street - ScoutJobs - The AI-curated global job board
Skip to content
State Street
Posted a month ago

Senior Data Engineer

State StreetSenior Data Engineer - Manager

Requirements

Strong hands-on experience with SQL, Advanced knowledge of Databricks and Microsoft Fabric, Experience building production-grade data pipelines, Experience with data modeling and medallion architecture

Skills

SQLDatabricksPySparkMicrosoft FabricAzure Data FactoryETL

About the role

Responsibilities

  • Design, build, and maintain scalable data pipelines to ingest data from diverse sources including SQL Server, Azure SQL, and cloud platforms
  • Leverage Microsoft Fabric and Azure Data Factory to ensure reliable and secure data ingestion
  • Develop and optimize ETL/ELT workflows using Databricks (PySpark, Spark SQL) and Microsoft Fabric
  • Implement medallion architecture (Bronze, Silver, Gold) to support scalable and governed analytics
  • Design and maintain Lakehouse and data warehouse models, including dimensional star/snowflake schemas
  • Optimize Spark jobs, SQL queries, and data models for performance, scalability, and cost efficiency
  • Monitor data pipelines and proactively resolve data quality and reliability issues
  • Create and maintain comprehensive documentation for data pipelines, transformation logic, and operational runbooks

Requirements

  • Strong hands-on experience with SQL and core data engineering concepts
  • Advanced working knowledge of Databricks (PySpark, Spark SQL) and/or Microsoft Fabric
  • Experience building and maintaining production-grade data pipelines and data models
  • Ability to demonstrate data engineering and analytics skills through an online portfolio or repository

Preferred Qualifications

  • Microsoft Certifications such as Fabric Data Engineer Associate (DP-700) or Databricks Data Engineer Associate
  • 9+ years of experience in data management or equivalent roles delivering large-scale analytics solutions
  • Prior experience with cloud data platforms, medallion architecture, and dimensional modeling
  • Exposure to data visualization and supporting analytical workloads

About the Company

State Street is a leading global provider of financial services to institutional investors. Our Global Technology Services (GTS) team drives digital transformation through advanced technologies like cloud, AI, and robotics. We offer a collaborative environment where innovation is valued and employees are empowered to solve complex technical problems in a next-generation financial services company.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Senior Data Engineer

State Street · Hyderabad

Sign up to apply