
Posted 22 days ago
Senior Data Engineer
State StreetSenior Data Engineer - Manager
Requirements
8+ years in data engineering, Proficiency in Snowflake, Experience with dbt, Microsoft Azure cloud infrastructure, Python and SQL proficiency, Helm charts and Kubernetes, CI/CD with GitHub Actions, Knowledge of LangChain and LangGraph
Skills
SnowflakeDBTAzurePythonSQLKubernetesGitHub ActionsLangChain
About the role
Responsibilities
- Build and optimize Snowflake data warehouses and data marts to ensure performance, cost efficiency, and data quality
- Design, develop, and maintain ELT/ETL pipelines using dbt for data transformation and modeling
- Architect and implement cloud infrastructure on Microsoft Azure, including ADF, ADLS Gen2, and Azure Key Vault
- Manage and deploy data platform components using Helm charts on Azure Kubernetes Service (AKS)
- Establish and maintain CI/CD pipelines for data platform code using GitHub Actions
- Monitor data pipeline health, SLAs, and data quality using observability tooling
- Implement data governance best practices including lineage tracking, schema management, and access controls
- Mentor junior engineers and contribute to internal engineering standards and documentation
- Partner with cross-functional teams to drive problem resolution and deliver end-to-end solutions
Requirements
- 8+ years of experience in a data engineering role
- Strong proficiency with Snowflake (warehouses, snow pipe, clustering, dynamic tables, and RBAC)
- Extensive experience with dbt (Data Build Tool) for data transformation
- Solid understanding of Microsoft Azure data services and cloud infrastructure
- Proficiency in Python and SQL for data processing and pipeline development
- Experience writing and maintaining Helm charts for Kubernetes deployments
- Strong command of CI/CD practices with GitHub Actions and Git/GitHub workflows
- Knowledge of AI-powered data agents and pipelines using LangChain and LangGraph
Preferred Qualifications
- Master's or Bachelor's degree in Computer Science or a related field
- Familiarity with streaming pipelines such as Kafka or Azure Event Hubs
- Experience leveraging GitHub Copilot for productivity in data pipeline development
About the Company
State Street is a leading global financial services provider. Our technology function, Global Technology Services (GTS), is vital to driving digital transformation and expanding business capabilities using advanced technologies such as cloud, artificial intelligence, and robotics process automation.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
State Street · Hyderabad
