
Posted 24 days ago
Lead Software Engineer
Scotiabank
Requirements
4+ years Python (PySpark, Pandas), 4+ years scalable ETL pipelines & data modeling, 4+ years large scale application development, 4+ years SQL, Experience with Postgres, MSSQL, Oracle, or Spark, Experience with Databricks or Snowflake, Experience with Azure or GCP, Experience with Airflow or Data Factory, Experience with CI/CD (Jenkins, Git), Bachelor's degree in Computer Science or Engineering
Skills
PythonDatabricksSQLPySparkAzureSparkCI/CD
About the role
Responsibilities
- Work closely with end users and business teams to understand needs and conduct gap analysis
- Partner with Architecture on system design and integration
- Deliver and enhance new and current solutions and applications throughout the full project life cycle
- Design and implement data models, database schemas, and scalable data pipelines
- Design and automate test sets, including functional, non-functional, regression, and performance testing
- Write deployment scripts and leverage CI/CD tools to promote code
- Support solutions in production and improve end-user experience by addressing complex queries
- Effectively communicate technical concepts to both technical and non-technical audiences
- Participate in SCRUM meetings and refactor legacy code as needed
Requirements
- 4+ years of experience with Python (including PySpark and Pandas)
- 4+ years of experience designing scalable ETL pipelines and data modeling
- 4+ years of experience developing and maintaining large-scale applications with complex integrations
- 4+ years of experience with SQL (reading, writing, and running scripts)
- Experience with data technologies such as Postgres, MSSQL, Oracle, Apache Spark, Kafka, or ElasticSearch
- Experience with data platforms like Databricks or Snowflake
- Experience with cloud platforms (Azure or GCP)
- Experience with workflow orchestration tools like Airflow or Data Factory
- Hands-on experience with DevOps tools including CI/CD (Jenkins, Git)
- Bachelor's degree in Computer Science, Engineering, or relevant experience
Preferred Qualifications
- Understanding of networking protocols and security principles
- Knowledge of Capital Markets products
- Experience with Docker and Kubernetes
- Experience working with real-time, high-availability, and low-latency systems
- Experience in multi-threaded applications
Benefits
- Competitive rewards program including bonus, flexible vacation, and personal/sick days
- Comprehensive benefits starting on day one
- Upskilling opportunities through online courses and tuition assistance
- Inclusive culture with various Employee Resource Groups (ERGs)
About the Company
Scotiabank is a leading bank in the Americas. The Global Banking and Markets Engineering (GBME) team is the technology engine that powers Scotiabank’s Corporate, Investment Banking, and Capital Markets businesses, developing market-leading solutions for capital markets products and analytics platforms.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeLead Software Engineer
Scotiabank · Toronto
