
Posted 18 hours ago
Data Engineer
Workplace OptionsData Engineer
Perks & benefits
Medical InsuranceAccommodationRelocation Allowance
Requirements
7+ years data engineering experience, Hands-on SSIS development, Expertise in Python, SQL, and Spark, Experience with Snowflake, Databricks, or BigQuery, Knowledge of star schema and dimensional modelling, Experience with distributed systems and large-scale datasets
Skills
PythonSQLSparkSSISSnowflakeDatabricksBigQuery
About the role
Responsibilities
- Design, develop, and enhance scalable batch and real-time data pipelines using modern processing technologies.
- Collaborate with data analysts and engineering teams to convert data requirements into technical specifications.
- Monitor, troubleshoot, and optimize data pipeline performance and reliability.
- Develop and refine data ingestion frameworks to integrate multiple internal and external data sources.
- Automate key data processes including ingestion, transformation, and validation.
- Implement CI/CD pipelines and infrastructure-as-code for data solutions.
- Maintain compliance with data privacy regulations and internal security standards.
Requirements
- 7+ years of experience in data engineering or related software engineering roles.
- Hands-on SSIS development experience, including designing metadata models and building ETL pipelines.
- Expertise in Python, SQL, and Spark for building and maintaining data models.
- Proven experience building data warehouses on Snowflake, Databricks, or BigQuery.
- Strong knowledge of star schema and dimensional modelling techniques.
- Experience working with distributed systems and large-scale datasets.
- Proficiency with Databricks, Data Lake, and SQL.
- Strong communication skills and the ability to work independently under pressure.
Benefits
- Group Mediclaim Insurance (6 lacs INR) and Accident Insurance.
- Gym reimbursement and tuition reimbursement.
- Employee Assistance Program (EAP) Support Services.
- Mentorship programs and WPO Cares.
- Employee exchange program and comprehensive training.
About the Company
Workplace Options (WPO) delivers human-centric solutions that empower people to thrive personally and professionally. With a global team of over 4,800 professionals, we provide real-time emotional support, therapy, coaching, and mindfulness services to millions of people worldwide. Now part of the TELUS Health family, we support over 150,000 organizations, including more than half of the Fortune 500 companies.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
Workplace Options · Bangalore
