AWS Data Engineer

Responsibilities

• Design, develop, and manage ETL workflows using AWS Glue
• Integrate data from multiple sources such as RDS, S3, Redshift, and other AWS services
• Transform raw data into structured formats for analysis, reporting, and business intelligence
• Optimize and fine-tune Glue jobs for performance and scalability
• Ensure proper data validation, error handling, and data quality in pipelines
• Collaborate with cross-functional teams to understand data requirements and deliver solutions
• Implement best practices for data processing, security, and governance within AWS environments
• Monitor and troubleshoot AWS Glue jobs to ensure pipeline reliability
• Provide technical support and guidance on AWS Glue usage and configurations

Requirements

• 3-5 years of experience in designing and building ETL pipelines using AWS Glue
• Proficiency in writing and optimizing PySpark or Python scripts for Glue jobs
• Strong experience with AWS services including S3, RDS, Lambda, Redshift, Athena, and IAM
• Understanding of data formats such as Parquet, Avro, ORC, and JSON
• Hands-on experience in building data lakes and data warehouses on AWS
• Experience with data modeling, database design, and large-scale data
• Strong troubleshooting and performance tuning skills for ETL jobs
• Experience with workflow orchestration tools like AWS Step Functions or Airflow
• Familiarity with AWS security best practices including IAM roles and encryption

About the Company

StatusNeo is a global consulting firm that empowers businesses through cutting-edge AI, automation, and cloud-first digital solutions. They are experts in product and platform engineering, helping businesses achieve digital transformation through Data, AI, and DevSecOps.