Data Engineer

Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines
• Build and manage data architecture for structured and unstructured data
• Develop and optimize ETL workflows using Apache Spark, Kafka, or Airflow
• Collaborate with analysts, data scientists, and business teams to implement data solutions
• Ensure data quality, integrity, and strong validation across all pipelines
• Implement data security, governance, and compliance standards
• Monitor, troubleshoot, and improve pipeline performance
• Work with relational and NoSQL databases
• Optimize SQL queries, stored procedures, and database tuning
• Create and manage reports using SSRS
• Support data migration and replication including CDC and SSIS
• Apply dimensional modelling concepts such as star and snowflake schemas
• Work within Agile teams and support DevOps-based CI/CD workflows
• Build and optimize Data Cubes

Requirements

• 6+ years of experience in data engineering
• Strong SQL proficiency with hands-on experience in query optimization and tuning
• Practical experience with ETL tools and data pipeline frameworks
• Strong understanding of data warehousing and BI concepts
• Experience with SSIS, CDC, and replication techniques
• Familiarity with NoSQL and relational databases
• Experience using SSRS for reporting
• Familiarity with Agile & DevOps practices
• Mandatory experience building and optimizing Data Cubes
• Ability to travel to South Africa for 2–3 months in January

Preferred Qualifications

• Python knowledge