Data Engineer

About the Company

Algotale is a technology-driven organization focused on building scalable data solutions, cloud-native architectures, and advanced analytics platforms. We help businesses transform data into actionable insights through modern data engineering practices.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines
• Build and optimize data architectures on AWS and/or GCP
• Develop data processing frameworks using PySpark
• Write complex and optimized SQL queries for large datasets
• Work with structured and unstructured data from multiple sources
• Implement data quality, validation, and governance frameworks
• Collaborate with data analysts, data scientists, and cross-functional teams
• Monitor and troubleshoot production data systems
• Ensure best practices in performance tuning and cost optimization in cloud environments

Requirements

• 3+ years of experience in Data Engineering
• Strong hands-on experience with AWS (S3, Redshift, Glue, EMR, Lambda) or GCP (BigQuery, Dataflow, Cloud Storage, Dataproc)
• Strong proficiency in SQL
• Hands-on experience with PySpark
• Experience with data warehousing concepts and dimensional modeling
• Familiarity with workflow orchestration tools like Airflow
• Understanding of distributed data processing systems
• Experience with version control tools like Git

Preferred Qualifications

• Experience with real-time data processing using Kafka or similar tools
• Knowledge of CI/CD pipelines
• Exposure to Infrastructure as Code such as Terraform or CloudFormation
• Basic understanding of machine learning pipelines