
Posted a month ago
Senior Data Engineer
State StreetSenior Data Engineer - Manager
Requirements
Strong hands-on experience with SQL, Advanced knowledge of Databricks and Microsoft Fabric, Experience building production-grade data pipelines, Experience with data modeling and medallion architecture
Skills
SQLDatabricksPySparkMicrosoft FabricAzure Data FactoryETL
About the role
Responsibilities
- Design, build, and maintain scalable data pipelines to ingest data from diverse sources including SQL Server, Azure SQL, and cloud platforms
- Leverage Microsoft Fabric and Azure Data Factory to ensure reliable and secure data ingestion
- Develop and optimize ETL/ELT workflows using Databricks (PySpark, Spark SQL) and Microsoft Fabric
- Implement medallion architecture (Bronze, Silver, Gold) to support scalable and governed analytics
- Design and maintain Lakehouse and data warehouse models, including dimensional star/snowflake schemas
- Optimize Spark jobs, SQL queries, and data models for performance, scalability, and cost efficiency
- Monitor data pipelines and proactively resolve data quality and reliability issues
- Create and maintain comprehensive documentation for data pipelines, transformation logic, and operational runbooks
Requirements
- Strong hands-on experience with SQL and core data engineering concepts
- Advanced working knowledge of Databricks (PySpark, Spark SQL) and/or Microsoft Fabric
- Experience building and maintaining production-grade data pipelines and data models
- Ability to demonstrate data engineering and analytics skills through an online portfolio or repository
Preferred Qualifications
- Microsoft Certifications such as Fabric Data Engineer Associate (DP-700) or Databricks Data Engineer Associate
- 9+ years of experience in data management or equivalent roles delivering large-scale analytics solutions
- Prior experience with cloud data platforms, medallion architecture, and dimensional modeling
- Exposure to data visualization and supporting analytical workloads
About the Company
State Street is a leading global provider of financial services to institutional investors. Our Global Technology Services (GTS) team drives digital transformation through advanced technologies like cloud, AI, and robotics. We offer a collaborative environment where innovation is valued and employees are empowered to solve complex technical problems in a next-generation financial services company.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
State Street · Hyderabad
