A
Posted 19 hours ago
Data Engineer
Algotale (Lumiq.Ai)Data Engineer
Requirements
5+ years Data Engineering experience, Proficiency in Python (OOP), Experience with Apache Airflow, Understanding of Snowflake architecture, Data pipeline design experience
Skills
PythonApache AirflowSnowflake
About the role
Responsibilities
- Design, develop, and maintain scalable data pipelines and backend data services using Python
- Build modular and reusable components using Object-Oriented Programming (OOP) principles
- Develop and manage workflow orchestration using Apache Airflow
- Work with Snowflake to design efficient data models, optimize queries, and manage data warehousing solutions
- Implement data validation and data quality checks across large datasets
- Collaborate with data analysts, data scientists, and product teams to deliver reliable data solutions
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability
- Maintain documentation for data workflows, pipelines, and architecture
Requirements
- 5+ years of experience in Data Engineering or related roles
- Strong proficiency in Python with emphasis on OOP concepts
- Experience building backend applications or SDKs using Python
- Hands-on experience with Apache Airflow
- Strong understanding of Snowflake architecture and concepts
- Experience designing and managing data pipelines
- Strong communication skills
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
Preferred Qualifications
- Experience implementing Data Quality frameworks
- Hands-on experience with Great Expectations
- Experience performing data quality checks on large datasets
- Advanced experience working with Snowflake
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
Algotale (Lumiq.Ai) · Mumbai
