Big Data Developer

Responsibilities

• Design and implement scalable data processing frameworks using AWS services
• Develop ETL pipelines for ingestion, transformation, and processing of large datasets
• Collaborate with data engineers, analysts, and architects to ensure efficient data workflows
• Optimize data storage and processing performance
• Ensure data quality, security, and compliance standards are met
• Troubleshoot and resolve issues related to data ingestion, transformation, and integration

Requirements

• 4+ years of experience in Big Data development
• Proficiency with Spark, Hadoop, Hive, and HDFS
• Programming skills in Python, Scala, or Java
• Hands-on experience with AWS services including S3, Glue, EMR, Lambda, Redshift, Athena, and Kinesis
• Experience with Airflow, Step Functions, or similar workflow tools
• Knowledge of SQL / NoSQL databases such as DynamoDB or PostgreSQL
• Proficiency with Git or Bitbucket
• Understanding of data warehousing concepts and data lake architectures

Preferred Qualifications

• Experience in performance tuning and optimizing large-scale data pipelines
• Exposure to CI/CD for data applications
• AWS certification

About the Company

StatusNeo is a digital consultancy that accelerates business transformation by leveraging cloud-native technologies. They specialize in building, maintaining, and monitoring highly scalable, modular applications on leading cloud platforms.