Senior Data Engineer at State Street - ScoutJobs - The AI-curated global job board
Skip to content
State Street
Posted 22 days ago

Senior Data Engineer

State StreetSenior Data Engineer - Manager

Requirements

8+ years in data engineering, Proficiency in Snowflake, Experience with dbt, Microsoft Azure cloud infrastructure, Python and SQL proficiency, Helm charts and Kubernetes, CI/CD with GitHub Actions, Knowledge of LangChain and LangGraph

Skills

SnowflakeDBTAzurePythonSQLKubernetesGitHub ActionsLangChain

About the role

Responsibilities

  • Build and optimize Snowflake data warehouses and data marts to ensure performance, cost efficiency, and data quality
  • Design, develop, and maintain ELT/ETL pipelines using dbt for data transformation and modeling
  • Architect and implement cloud infrastructure on Microsoft Azure, including ADF, ADLS Gen2, and Azure Key Vault
  • Manage and deploy data platform components using Helm charts on Azure Kubernetes Service (AKS)
  • Establish and maintain CI/CD pipelines for data platform code using GitHub Actions
  • Monitor data pipeline health, SLAs, and data quality using observability tooling
  • Implement data governance best practices including lineage tracking, schema management, and access controls
  • Mentor junior engineers and contribute to internal engineering standards and documentation
  • Partner with cross-functional teams to drive problem resolution and deliver end-to-end solutions

Requirements

  • 8+ years of experience in a data engineering role
  • Strong proficiency with Snowflake (warehouses, snow pipe, clustering, dynamic tables, and RBAC)
  • Extensive experience with dbt (Data Build Tool) for data transformation
  • Solid understanding of Microsoft Azure data services and cloud infrastructure
  • Proficiency in Python and SQL for data processing and pipeline development
  • Experience writing and maintaining Helm charts for Kubernetes deployments
  • Strong command of CI/CD practices with GitHub Actions and Git/GitHub workflows
  • Knowledge of AI-powered data agents and pipelines using LangChain and LangGraph

Preferred Qualifications

  • Master's or Bachelor's degree in Computer Science or a related field
  • Familiarity with streaming pipelines such as Kafka or Azure Event Hubs
  • Experience leveraging GitHub Copilot for productivity in data pipeline development

About the Company

State Street is a leading global financial services provider. Our technology function, Global Technology Services (GTS), is vital to driving digital transformation and expanding business capabilities using advanced technologies such as cloud, artificial intelligence, and robotics process automation.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Senior Data Engineer

State Street · Hyderabad

Sign up to apply