Data Engineer

Responsibilities

• Design, develop, and maintain robust data pipelines using Python, SQL, and Apache Spark
• Build and manage data workflows and ETL/ELT processes in Azure Data Factory or similar tools
• Optimize data storage and performance using Azure Data Lake, Blob Storage, and SQL-based data warehouses
• Collaborate with cross-functional teams to translate requirements into scalable solutions
• Ensure data integrity, governance, and security across platforms
• Monitor and troubleshoot data pipelines for failures and performance issues
• Participate in code reviews and adhere to best practices

Requirements

• 3-5 years of experience in data engineering
• Strong proficiency in Python for scripting and data processing
• Advanced SQL skills for data manipulation and performance tuning
• Hands-on experience with Apache Spark (PySpark preferred)
• Deep understanding of Azure services including Data Factory, Databricks, Data Lake, Blob Storage, and Synapse
• Experience with CI/CD and version control tools like Git or Azure DevOps
• Knowledge of data modeling and data warehousing concepts

About the Company

Statusneo is a digital consultancy that accelerates business transformation by leveraging cloud-native technologies. They specialize in cloud-native technology consulting and solutions, building highly scalable, modular applications on leading cloud platforms.