Data Engineer

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines to ingest data from multiple sources including relational databases, REST APIs, and streaming platforms.
• Implement and manage data workflows within the Google Cloud Platform ecosystem using tools such as Cloud Dataflow, Cloud Composer (Apache Airflow), Pub/Sub, and Dataproc.
• Model, design, and optimize BigQuery tables, views, and schemas to ensure high performance through effective partitioning and clustering.
• Integrate new data sources into the corporate Data Lake and Data Warehouse while ensuring data governance, security, and access control via IAM and Data Catalog.
• Collaborate with data scientists, BI analysts, and architects to provide high-quality datasets for analytical consumption and Machine Learning models.
• Automate data quality validation and monitoring processes using tools like Great Expectations or Cloud Monitoring.
• Support the maintenance of data infrastructure as code (IaC) using Terraform or Deployment Manager.

Requirements

• Degree in Computer Science, Systems Engineering, or a related field.
• 2 to 4 years of proven experience in data engineering and ETL/ELT pipeline development.
• Advanced knowledge of BigQuery, specifically in query optimization, partitioning, and clustering.
• Hands-on experience with Google Cloud Platform services (Cloud Storage, Dataflow, Cloud Composer, Pub/Sub, and Cloud Functions).
• Proficiency in Python (pandas, PySpark, SQLAlchemy) and advanced SQL.
• Experience with tools such as Apache Beam, dbt, Terraform, Git/GitHub, and Docker.
• Knowledge of Apache Kafka or Pub/Sub for streaming data management.
• Intermediate to advanced English proficiency (minimum 80%), with the ability to read technical documentation fluently.

Preferred Qualifications

• GCP Certifications (Professional Data Engineer or Associate Cloud Engineer).
• Experience working with Agile methodologies such as Scrum or Kanban.

About the Company

Rotoplas is dedicated to improving people's quality of life through innovative and sustainable water solutions. We promote diversity and inclusion, seeking individuals who share our values and mission to bring better water to everyone.