
Posted 22 days ago
Senior Data Engineer
SOTISenior Data Engineer
Requirements
7+ years in Data Engineering or Analytics Engineering, Hands-on experience with SQL, Python, PySpark, and Spark SQL, Experience with Azure Synapse Analytics or Microsoft Fabric, Knowledge of cloud-native data architectures and medallion architectures, Experience with Git-based source control and CI/CD pipelines
Skills
SQLPythonPySparkAzureMicrosoft FabricETL
About the role
Responsibilities
- Design, build, and maintain production-grade ETL/ELT pipelines using SQL, Python, PySpark, and Spark SQL
- Own end-to-end data pipelines from ingestion through curated, analytics-ready datasets
- Collaborate with Lead Engineers and Data Architects on on-prem to cloud migration initiatives
- Build and operate solutions across hybrid data platforms, including SQL Server, Azure Synapse, and Microsoft Fabric
- Develop and maintain Fabric Lakehouses, Warehouses, Pipelines, and Notebooks
- Optimize workloads for performance, reliability, and cost efficiency
- Implement data validation, reconciliation, monitoring, logging, and alerting
- Mentor junior data engineers through code reviews and best practice sharing
- Apply disciplined engineering practices including version control, CI/CD, and testing
Requirements
- 7+ years of experience in Data Engineering, Analytics Engineering, or a related technical role
- Strong hands-on experience with SQL, Python, PySpark, and Spark SQL in distributed environments
- Proven experience building and supporting enterprise-scale ETL/ELT pipelines in the cloud
- Strong experience with Azure-based data platforms, including Azure Synapse Analytics and/or Microsoft Fabric
- Solid understanding of cloud-native data architectures and medallion architectures
- Experience with Git-based source control, CI/CD pipelines, and automated testing
Preferred Qualifications
- Hands-on experience with Microsoft Fabric Lakehouse and Spark workloads
- Experience with Azure Data Factory, Fabric Pipelines, or orchestration tools
- Familiarity with data governance, lineage, and certification in cloud platforms
- Relevant certifications such as Microsoft Certified: Azure Data Engineer Associate or Microsoft Fabric Analytics Engineer
About the Company
SOTI is a proven innovator and industry leader for simplifying business mobility solutions by making them smarter, faster, and more reliable. With over 17,000 customers globally, SOTI provides the go-to mobile platform to manage, secure, and support business-critical devices.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
SOTI · Kochi
