Senior Databricks Data Engineer

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Python
• Build and optimize high-performance Apache Spark applications for batch and real-time processing
• Develop and manage Kafka-based streaming solutions for real-time data ingestion
• Design and implement data architectures leveraging Delta Lake and open table formats
• Deploy and manage data solutions across Azure and/or AWS cloud platforms
• Implement data quality, governance, security, and performance optimization best practices
• Contribute to microservices-based architectures and work within Kubernetes (K8S) environments

Requirements

• 10+ years of experience in Data Engineering or Data Platform Development
• Strong hands-on expertise with Databricks and Delta Lake
• Deep proficiency in Apache Spark, Apache Kafka, Python, and SQL
• Experience with Azure and/or AWS cloud platforms
• Strong knowledge of Java development and microservices architecture
• Hands-on experience with Kubernetes (K8S) and containerized applications
• Proven track record of designing large-scale, enterprise-grade data solutions

Preferred Qualifications

• Experience working in Agile/Scrum environments
• Strong analytical, troubleshooting, and problem-solving skills
• Excellent communication and stakeholder management abilities
• Experience building real-time streaming and event-driven architectures
• Knowledge of data governance, data quality, and security best practices

Benefits

• Competitive compensation and comprehensive benefits package
• Opportunity to work with cutting-edge cloud and data technologies
• Challenging, high-impact projects in a collaborative environment
• Professional growth and career development opportunities
• Exposure to large-scale enterprise data modernization initiatives

About the Company

Matrix-IFS is a global, dynamic technology services and consulting company with over 17,000 employees worldwide. We specialize in the design, development, and implementation of advanced technologies, software solutions, and digital products across sectors including Finance, Telecom, Healthcare, and Defense.