Senior Data Engineer at SOTI - ScoutJobs - The AI-curated global job board
Skip to content
SOTI
Posted 22 days ago

Senior Data Engineer

SOTISenior Data Engineer

Requirements

7+ years in Data Engineering or Analytics Engineering, Hands-on experience with SQL, Python, PySpark, and Spark SQL, Experience with Azure Synapse Analytics or Microsoft Fabric, Knowledge of cloud-native data architectures and medallion architectures, Experience with Git-based source control and CI/CD pipelines

Skills

SQLPythonPySparkAzureMicrosoft FabricETL

About the role

Responsibilities

  • Design, build, and maintain production-grade ETL/ELT pipelines using SQL, Python, PySpark, and Spark SQL
  • Own end-to-end data pipelines from ingestion through curated, analytics-ready datasets
  • Collaborate with Lead Engineers and Data Architects on on-prem to cloud migration initiatives
  • Build and operate solutions across hybrid data platforms, including SQL Server, Azure Synapse, and Microsoft Fabric
  • Develop and maintain Fabric Lakehouses, Warehouses, Pipelines, and Notebooks
  • Optimize workloads for performance, reliability, and cost efficiency
  • Implement data validation, reconciliation, monitoring, logging, and alerting
  • Mentor junior data engineers through code reviews and best practice sharing
  • Apply disciplined engineering practices including version control, CI/CD, and testing

Requirements

  • 7+ years of experience in Data Engineering, Analytics Engineering, or a related technical role
  • Strong hands-on experience with SQL, Python, PySpark, and Spark SQL in distributed environments
  • Proven experience building and supporting enterprise-scale ETL/ELT pipelines in the cloud
  • Strong experience with Azure-based data platforms, including Azure Synapse Analytics and/or Microsoft Fabric
  • Solid understanding of cloud-native data architectures and medallion architectures
  • Experience with Git-based source control, CI/CD pipelines, and automated testing

Preferred Qualifications

  • Hands-on experience with Microsoft Fabric Lakehouse and Spark workloads
  • Experience with Azure Data Factory, Fabric Pipelines, or orchestration tools
  • Familiarity with data governance, lineage, and certification in cloud platforms
  • Relevant certifications such as Microsoft Certified: Azure Data Engineer Associate or Microsoft Fabric Analytics Engineer

About the Company

SOTI is a proven innovator and industry leader for simplifying business mobility solutions by making them smarter, faster, and more reliable. With over 17,000 customers globally, SOTI provides the go-to mobile platform to manage, secure, and support business-critical devices.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Senior Data Engineer

SOTI · Kochi

Sign up to apply