Data Engineer

Responsibilities

• Design, build, and maintain efficient and reliable data pipelines using SQL and Python
• Leverage Apache Airflow for orchestration
• Develop ETL processes to move data between various sources and destinations
• Implement data quality checks and validation routines
• Collaborate with data analysts and scientists to translate needs into actionable solutions
• Optimize existing data pipelines for performance and scalability
• Develop and maintain documentation for data pipelines and processes
• Contribute to the development and maintenance of data governance policies

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field
• 2-3 years of experience as a Data Engineer or in a similar role
• Strong proficiency in SQL for data querying, manipulation, and analysis
• Excellent programming skills in Python (Pandas, NumPy, Dask, Airflow)
• Proficiency in using Apache Airflow for orchestration, scheduling, and monitoring
• Familiarity with cloud platforms (AWS, Azure, GCP) and data warehousing (Snowflake, Redshift)
• Strong analytical and problem-solving skills

Preferred Qualifications

• Experience with data visualization tools like Tableau or Power BI

About the Company

Quation specializes in delivering synergistic solutions that enable businesses to make informed decisions through advanced analytics, data engineering, and artificial intelligence.