W
Posted 22 days ago
Data Engineering Manager
Wells FargoData Engineering Manager
Requirements
4+ years Software Engineering experience, 2+ years Leadership experience, Experience with Spark Structured Streaming or Apache Flink, Proficiency in Python, SQL, and bash, Experience with big data pipelines (Spark, Hive, Hadoop), Knowledge of orchestration tools like Airflow or Autosys, Experience with cloud-native engineering and containerization
Skills
PythonSQLApache SparkAirflowDockerKubernetesHadoopCI/CD
About the role
Responsibilities
- Manage, coach, and develop a team of engineers and less experienced managers
- Design, develop, and maintain metadata-driven, scalable data engineering frameworks for financial risk processes
- Ensure adherence to Banking Platform Architecture and meet non-functional requirements
- Act as a technical representative during cross-team collaborative efforts and planning
- Identify and resolve technology roadblocks regarding code, build, and deployment
- Collaborate with Product Managers to influence technology requirements and product roadmaps
- Manage allocation of people and financial resources, including career development and performance management
- Build engineering skills side-by-side in the codebase and conduct peer reviews
Requirements
- 4+ years of Software Engineering experience
- 2+ years of Leadership experience
- Proficiency in Python, SQL, and bash scripting
- Experience with big data pipelines using Spark, Hive, or Hadoop
- Knowledge of orchestration tools such as Airflow or Autosys
- Experience with cloud-native engineering and containerization (Docker, K8s)
Preferred Qualifications
- Experience with streaming frameworks like Spark Structured Streaming or Apache Flink
- Experience architecting pipelines using distributed systems patterns and Medallion architectures
- Hands-on experience with optimization techniques like Z-ordering, clustering, and vectorized IO
- Working knowledge of REST APIs, Object Storage, Dremio, and CI/CD pipelines
- Strong foundation in data modeling and database design
- Exposure to financial risk, treasury functions, or Asset & Liability Management (ALM)
- Knowledge of data governance platforms such as Collibra, Alation, or Purview
- Experience applying GenAI for metadata extraction or pipeline optimization
About the Company
Wells Fargo & Company is a leading financial services company with approximately $2.1 trillion in assets, providing a diversified set of banking, investment, and mortgage products and services globally.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineering Manager
Wells Fargo · Bengaluru
