Senior Databricks Engineer

Responsibilities

• Design, develop, and optimize large-scale data processing pipelines using Databricks on Azure
• Implement ETL processes to ingest and transform data from various sources
• Develop scalable and efficient data models to support analytics and reporting
• Integrate Databricks with Azure services including Data Lake, SQL Database, Synapse Analytics, and Machine Learning
• Utilize Azure DevOps for CI/CD of data solutions
• Collaborate with product teams to integrate SaaS product data into the platform
• Monitor and optimize the performance of data pipelines and queries
• Mentor and guide junior engineers and promote best practices
• Maintain comprehensive documentation of data engineering processes

Requirements

• 8-10 years of experience in data engineering or related roles
• Extensive experience with Databricks and Azure
• Proficiency in Spark, SQL, Python, and Scala
• Strong understanding of Azure services and architecture
• Experience with data warehousing, ETL/ELT processes, and data modeling
• Knowledge of CI/CD practices and Azure DevOps
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

Preferred Qualifications

• Certifications in Databricks, AWS, or Azure
• Experience with machine learning and AI integration
• Familiarity with data visualization tools like Power BI or Tableau

Benefits

• Competitive salary and performance-based bonuses
• Comprehensive health insurance including parents
• Complementary buffet meal every day
• Professional development opportunities and continuous learning

About the Company

Saletancy is a global sales and marketing company specializing in lead generation and appointment setting, providing affordable solutions to businesses of all sizes.