M
Posted 20 hours ago
Data Engineer
Mantle Solutions
Requirements
Bachelor's degree in CS or related field, 3+ years of data engineering experience, Strong Microsoft Azure expertise, Experience with Databricks and ADLS Gen2, Proficiency in SQL, Python, and PySpark
Skills
AzureDatabricksPythonPySparkSQL
About the role
Responsibilities
- Design, develop, and maintain scalable data pipelines and integration solutions using Azure services
- Build and optimize ETL/ELT workflows using Azure Data Factory, Azure Databricks, and other Azure-native tools
- Develop and manage data lakes and data warehouses using Azure Data Lake Storage, Azure Synapse Analytics, and Azure SQL
- Implement data ingestion frameworks for batch and real-time data processing
- Ensure data quality, integrity, security, and governance across the data platform
- Optimize data processing jobs for performance, scalability, and cost efficiency
- Collaborate with business analysts, data scientists, and architects to understand data requirements
- Implement CI/CD processes and DevOps best practices for data engineering solutions
Requirements
- Bachelor's degree in Computer Science, IT, Engineering, or a related field
- 3+ years of experience in data engineering or a related role
- Strong experience with Microsoft Azure cloud services
- Hands-on experience with Databricks, Azure Data Lake Storage (ADLS Gen2), and Azure SQL Database
- Strong SQL development and query optimization skills
- Proficiency with Python and PySpark
- Knowledge of data modeling, data warehousing, and dimensional modeling concepts
Preferred Qualifications
- Experience with Delta Lake and Medallion Architecture
- Knowledge of streaming technologies such as Azure Event Hub or Azure Stream Analytics
- Experience with Power BI integration
- Microsoft Certified: Azure Data Engineer Associate (DP-203)
- Experience with Kafka or Databricks Applications
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
Mantle Solutions · Bangalore
