Big Data Engineer

Responsibilities

• Design, build, and maintain scalable data pipelines using Apache Spark, Hadoop, and Kafka
• Collaborate with data scientists, analysts, and IT teams to identify data requirements
• Ensure high data quality and integrity through robust validation and testing
• Optimize data storage solutions for performance and cost-efficiency
• Monitor and troubleshoot data processing workflows
• Document data architectures, processes, and workflows

Requirements

• Bachelor's degree in Computer Science, IT, or a related field
• 3+ years of experience in Big Data Engineering
• Proficiency in Apache Spark, Hadoop, and Apache Kafka
• Strong coding skills in Java, Scala, or Python
• Familiarity with ETL tools and data processing frameworks
• Experience with cloud platforms like AWS, Azure, or Google Cloud
• Experience with HDFS, S3, or BigQuery

Preferred Qualifications

• Experience with machine learning frameworks and algorithms
• Knowledge of data governance and security best practices
• Familiarity with Docker and Kubernetes

Benefits

• Attractive Package
• Family Benefits
• Visa
• Air Tickets