Data Engineer

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines to ingest data from multiple sources including relational databases, REST APIs, and streaming platforms.
• Implement and manage data workflows within Google Cloud Platform using tools such as Cloud Dataflow, Cloud Composer (Apache Airflow), Pub/Sub, and Dataproc.
• Model and optimize BigQuery tables, views, and schemas, ensuring high performance through effective partitioning and clustering.
• Integrate new data sources into the corporate Data Lake and Data Warehouse while ensuring data governance, security, and traceability.
• Collaborate with data scientists, BI analysts, and architects to provide high-quality datasets for analytical consumption and Machine Learning models.
• Automate data quality validation and monitoring processes using tools like Great Expectations or Cloud Monitoring.
• Support the maintenance of data infrastructure as code (IaC) using Terraform or Deployment Manager.

Requirements

• Degree in Computer Science, Systems Engineering, or a related field.
• 2 to 4 years of proven experience in data engineering and ETL/ELT pipeline development.
• Advanced proficiency in SQL and Python (including libraries such as pandas, PySpark, and SQLAlchemy).
• Practical experience with Google Cloud Platform services (Cloud Storage, Dataflow, Cloud Composer, Pub/Sub, and Cloud Functions).
• Advanced knowledge of BigQuery optimization, including partitioning and clustering.
• Experience with Apache Beam, dbt (Data Build Tool), Terraform, Git/GitHub, and Docker.
• Knowledge of Apache Kafka or Pub/Sub for streaming data management.
• Intermediate-advanced English proficiency, with the ability to read technical documentation fluently.

Preferred Qualifications

• GCP Certifications (Professional Data Engineer or Associate Cloud Engineer).
• Experience working with Agile methodologies such as Scrum or Kanban.

About the Company

Rotoplas is dedicated to improving people's quality of life through innovative and sustainable water solutions. We promote diversity and inclusion, seeking individuals who share our values and mission to bring better water to everyone.