Data Engineer

Responsibilities

• Design, develop, and maintain data pipelines using Azure Databricks
• Build and optimize data transformations using PySpark and SQL in Databricks
• Implement and maintain Lakehouse architectures using Delta Lake
• Develop ETL/ELT pipelines orchestrated through Azure Data Factory
• Integrate data from multiple sources into the data platform and analytical layers
• Design and maintain data models and data warehouse structures for analytics
• Ensure data quality, scalability, and performance of large-scale data processing pipelines
• Collaborate with BI teams to support Power BI and reporting platforms
• Support and evolve existing SQL Server data platforms and ETL solutions (SSIS)

Requirements

• 3+ years of experience in Data Engineering or Data Warehouse development
• Experience with Azure Databricks
• Experience developing data pipelines using PySpark and Spark SQL
• Solid understanding of distributed data processing and big data concepts
• Experience working with Delta Lake and Lakehouse architectures
• Strong SQL skills and experience with SQL Server relational databases
• Experience building data pipelines using Azure Data Factory
• Experience handling large datasets and performance optimization

Preferred Qualifications

• Experience with Spark optimization techniques
• Experience with structured streaming in Databricks
• Knowledge of CI/CD pipelines for data platforms (Azure DevOps)
• Familiarity with Power BI
• Experience in migrating from traditional ETL process to cloud architectures

About the Company

Miratech is a global IT services and consulting company that supports digital transformation for some of the world's largest enterprises. We are a values-driven organization with a culture of Relentless Performance, operating across 5 continents and over 25 countries.