Azure Databricks Developer

Responsibilities

• Develop and maintain scalable data pipelines using Azure Databricks
• Design and implement ETL/ELT workflows using PySpark / Spark SQL
• Work with Azure Data Lake Storage (ADLS), Azure Synapse, and other Azure services
• Optimize performance of Spark jobs and data workflows
• Collaborate with data engineers, analysts, and business stakeholders
• Implement data quality checks, monitoring, and logging
• Ensure data security and governance best practices
• Troubleshoot and resolve data pipeline issues

Requirements

• 6+ years of experience
• Strong experience with Azure Databricks
• Proficiency in Python (PySpark) and SQL
• Experience with Apache Spark and distributed data processing
• Hands-on experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics
• Understanding of data warehousing concepts
• Experience in building batch and streaming pipelines
• Familiarity with Git

Preferred Qualifications

• Experience with Delta Lake
• Knowledge of CI/CD pipelines (Azure DevOps)
• Exposure to Kafka / Event Hubs for streaming
• Understanding of data modeling techniques
• Azure certifications (e.g., DP-203)

About the Company

Algotale offers the opportunity to work on cutting-edge cloud data technologies in a collaborative and growth-oriented environment, providing exposure to large-scale data engineering projects.