
Posted a day ago
Senior Data Engineer
CodvoSenior Data Engineer (Databricks)
Requirements
Databricks platform expertise, Python proficiency, Unity Catalog experience, AWS services knowledge, Data Lake/Lakehouse architecture understanding, Dashboard and reporting experience
Skills
DatabricksPythonAWS
About the role
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Python
- Build and optimize ETL workflows for both structured and unstructured data
- Implement and manage data governance using Unity Catalog
- Work within Databricks Lakehouse architecture to implement industry best practices
- Integrate AWS data services including S3, IAM, and VPC
- Collaborate with cross-functional teams to deliver high-quality data solutions
- Build dashboards and support various data visualization requirements
- Ensure high standards for data quality, reliability, and performance optimization
Requirements
- 4-8+ years of experience in data engineering
- Strong expertise with the Databricks platform
- Proficiency in Python for data engineering and ETL pipeline development
- Hands-on experience with Unity Catalog
- Solid understanding of Data Lake and Lakehouse architecture
- Knowledge of AWS services (S3, IAM, VPC)
- Experience building dashboards and reporting solutions
Preferred Qualifications
- Experience with REST API development using Flask or FastAPI
- Knowledge of authentication and authorization protocols such as OAuth and IAM roles
- Strong query optimization and PySpark performance tuning skills
- Exposure to building ML/AI pipelines
- Familiarity with Databricks AI/BI capabilities
About the Company
Codvo builds scalable, future-ready digital platforms that drive real business impact. We foster a culture of innovation, collaboration, and ownership, working closely across product and engineering teams to deliver high-quality, user-centered experiences.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
Codvo · Pune
