Data Engineer Specialist

Responsibilities

• Design, implement, and maintain highly automated and reliable data pipelines
• Monitor and troubleshoot data flows in real time to ensure seamless data flow
• Implement data-driven DevOps and DataOps practices for pipeline management
• Optimize cloud infrastructure to handle large volumes of data efficiently
• Manage permissions and access to data within secure environments
• Document processes to ensure ease of maintenance and future scalability
• Collaborate with cross-functional operational and infrastructure teams to optimize data operations

Requirements

• Bachelor's degree in Computer Science, Data Engineering, or a related field
• 2-3 years of experience in data engineering roles with a focus on pipelines
• Proficiency with tools such as Apache Airflow, Spark, or BigQuery
• Strong knowledge of database management systems including SQL and NoSQL (e.g., PostgreSQL, MySQL, MongoDB)
• Proven expertise in managing cloud-based data infrastructure (AWS, Azure, or GCP)
• Familiarity with automation and monitoring tools like Cloud Logging

Preferred Qualifications

• AWS Certified DevOps Engineer certification
• Google Cloud Professional Data Engineer certification
• Previous experience working with DataOps methodologies

About the Company

ScotiaTech is Scotiabank's innovative technology hub located in Bogota, Colombia. As a business unit within ScotiaGBS, we support the bank's diverse technology systems and processes, offering an inclusive, high-performing, and creative work environment.