
Posted 23 days ago
Senior Data Engineer
GSSTech GroupSenior Data Engineer
Requirements
Python, PySpark, Apache Spark optimization, Big Data technologies, Hadoop ecosystem, SQL, Machine learning data pipelines, Git, Distributed systems, Bachelor's or Master's in Computer Science or related field
Skills
PythonPySparkApache SparkSQLHadoopGit
About the role
Responsibilities
- Design, develop, and optimize scalable data pipelines using PySpark, Python, and Big Data technologies
- Build feature engineering workflows and data transformation pipelines to support machine learning model development
- Ingest, cleanse, and process structured and unstructured datasets from multiple enterprise sources
- Optimize Spark workloads and implement performance tuning strategies for large-scale distributed environments
- Collaborate with Data Scientists, ML Engineers, and Analytics Delivery Leads to deliver data-driven solutions
- Ensure data quality, governance, and operational efficiency across all data platforms
- Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives
Requirements
- Strong hands-on experience with Python and PySpark development
- Deep expertise in Apache Spark, including optimization and performance tuning
- Extensive experience with Big Data technologies and the Hadoop ecosystem
- Proficiency in SQL and complex data transformation logic
- Experience building machine learning data pipelines and feature engineering workflows
- Strong understanding of distributed systems and scalable architectures
- Proficiency with Git and version control best practices
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
Preferred Qualifications
- Exposure to cloud-based data engineering platforms
- Experience with DevOps, CI/CD, and automated deployment workflows
- Knowledge of real-time streaming or event-driven data architectures
- Experience in Banking or Financial Services
- Familiarity with enterprise analytics and AI/ML ecosystems
About the Company
GSSTech Group provides high-level technical expertise and engineering solutions to support enterprise-scale data and digital transformation initiatives.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
GSSTech Group · Dubai
