Data Engineer

Responsibilities

• Migrate dashboards and reports from Hadoop to GCP, converting Hive and Pig jobs to BigQuery or Spark
• Ensure data consistency and accuracy through validation and cleansing techniques
• Collaborate with cross-functional teams to identify and resolve data-related issues
• Implement security and governance including Role-based access control (RBAC) and data lineage tools

Requirements

• 5+ years of experience as a Data Engineer
• Proficiency in Python and PySpark
• Extensive experience with GCP, BigQuery, and Airflow
• Strong knowledge of SQL and NoSQL databases
• Bachelor's degree in Computer Science or a related engineering field
• Knowledge of database management systems like MySQL

About the Company

NucleusTeq offers a positive and supportive culture that encourages associates to do their best work. We provide well-being programs and a collaborative environment focused on professional development and cutting-edge technologies.