W
Posted a month ago
Lead Software Engineer
Wells FargoLead Software Engineer: Data Engineering, GCP, GenAI
Requirements
5+ years Software Engineering experience, 3-4 years project lead experience, GenAI Automation expertise, Big data implementation experience, GCP transformation experience
Skills
GCPPythonSQLApache SparkBigQueryGenAIKafkaAirflow
About the role
Responsibilities
- Design and execute comprehensive data migration strategies from on-premises or legacy platforms to GCP
- Migrate structured and semi-structured data to BigQuery, Bigtable, and other GCP storage solutions
- Build and maintain scalable migration pipelines using Python, SQL, and Dataproc (Apache Spark)
- Implement batch and streaming migration patterns using Cloud Composer, Kafka, and Google Pub/Sub
- Leverage GenAI and automation techniques to accelerate data discovery, schema mapping, and migration assessments
- Apply GenAI-assisted data transformation and code generation to optimize migration patterns
- Enable metadata management, lineage, and governance using Dataplex and Data Catalog
Requirements
- 5+ years of Software Engineering experience
- 3 to 4 years of project lead experience
- Expertise in GenAI Automation
- Experience with small to large scale big data implementation, including Spark flows
- Proven experience with GCP transformation
Preferred Qualifications
- Hands-on experience with Google Cloud Platform (GCP) services including BigQuery, Dataproc, and Bigtable
- Proficiency in Python for ETL/ELT pipelines and SQL for data transformation
- Experience with Cloud Composer (Apache Airflow), Kafka, and Google Pub/Sub
- Knowledge of GenAI technologies including LLMs, embeddings, and prompt engineering
- Familiarity with Vertex AI or BigQuery ML
About the Company
Wells Fargo & Company is a leading financial services company with approximately $2.1 trillion in assets, providing a diversified set of banking, investment, and mortgage products and services globally.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeLead Software Engineer
Wells Fargo · Hyderabad
