Data Engineer (MLOps/Analytics Focus)

Responsibilities

• Design, optimize, and maintain scalable data pipelines within the Databricks ecosystem.
• Implement and maintain Delta Tables and Databricks notebooks while ensuring data quality.
• Train, deploy, and monitor machine learning models using MLflow.
• Develop Power BI dashboards and business insight reporting to support data-driven decision-making.
• Monitor API data integrations and troubleshoot failures to ensure data consistency.
• Manage Git-based workflows, including pull requests, branch syncing, and merge conflict resolution.
• Collaborate with data scientists, analysts, and business stakeholders.

Requirements

• Degree or Diploma in Computer Science, Data Engineering, Information Systems, Mathematics, Statistics, or a related field.
• 3–5 years of experience in Data Engineering or related roles.
• Hands-on experience with Databricks and Delta Tables.
• Proven experience with MLflow and machine learning deployment processes.
• Experience with Power BI dashboard development.
• Strong experience with Git version control workflows.
• Exposure to API integrations and monitoring.

Preferred Qualifications

• Proficiency in Python and SQL.
• Experience with Azure Data Services and Azure DevOps.
• Knowledge of Spark / PySpark.
• Understanding of CI/CD for ML pipelines and MLOps best practices.

About the Company

Blue Pearl PTY LTD provides specialized IT services and technical expertise. This role is a contract position based in Johannesburg, offering strong long-term potential with multi-year engagement possibilities.