Posted 5 hours ago
Middle Data Engineer
Miratech
Perks & benefits
Health InsuranceRelocation Allowance
Requirements
3+ years Data Engineering experience, Azure Databricks, PySpark, Spark SQL, Delta Lake, SQL Server, Azure Data Factory
Skills
DatabricksPySparkAzure Data Factory
About the role
Responsibilities
- Design, develop, and maintain data pipelines using Azure Databricks
- Build and optimize data transformations using PySpark and SQL in Databricks
- Implement and maintain Lakehouse architectures using Delta Lake
- Develop ETL/ELT pipelines orchestrated through Azure Data Factory
- Integrate data from multiple sources into the data platform and analytical layers
- Design and maintain data models and data warehouse structures for analytics
- Ensure data quality, scalability, and performance of large-scale data processing pipelines
- Collaborate with BI teams to support Power BI and reporting platforms
- Support and evolve existing SQL Server data platforms and ETL solutions (SSIS)
Requirements
- 3+ years of experience in Data Engineering or Data Warehouse development
- Experience with Azure Databricks
- Experience developing data pipelines using PySpark and Spark SQL
- Solid understanding of distributed data processing and big data concepts
- Experience working with Delta Lake and Lakehouse architectures
- Strong SQL skills and experience with SQL Server relational databases
- Experience building data pipelines using Azure Data Factory
- Experience handling large datasets and performance optimization
Preferred Qualifications
- Experience with Spark optimization techniques
- Experience with structured streaming in Databricks
- Knowledge of CI/CD pipelines for data platforms (Azure DevOps)
- Familiarity with Power BI
- Experience in migrating from traditional ETL process to cloud architectures
Benefits
- Competitive Pay and Benefits including health insurance
- Relocation program
- Work From Anywhere Culture
- Professional development opportunities and certification programs
- Mentorship and talent investment programs
About the Company
Miratech is a global IT services and consulting company that supports digital transformation for some of the world's largest enterprises. We are a values-driven organization with coverage across 5 continents and operations in over 25 countries.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeMiddle Data Engineer
Miratech · Katowice
