
Posted 6 hours ago
Azure Data Engineer - Senior
EYAzure Data Engineer
Requirements
4+ years IT experience, 2+ years PySpark experience, Hands-on with Azure Synapse or ADF, Experience with Databricks, Knowledge of Azure Data Lake, Computer science graduate or equivalent
Skills
AzureDatabricksPySparkSQLETL
About the role
Responsibilities
- Design, build, and deploy data pipelines and workflows using Databricks notebooks or the Azure Data Platform (Synapse or ADF).
- Develop and optimize PySpark and SparkSQL for efficient data processing and analytics.
- Manage ETL design, development, and the migration of existing on-premise ETL routines to cloud services.
- Work with Delta Table formats within Databricks or Synapse environments.
- Design and optimize model codes to ensure faster execution and performance.
- Collaborate with senior leaders to understand business goals and contribute to workstream delivery.
- Participate in the full Big Data solution delivery life cycle, including analysis, design, testing, and production support.
Requirements
- 4+ years of overall IT experience.
- 2+ years of relevant experience in PySpark with Synapse, ADF, or Databricks.
- Hands-on experience with Azure Synapse, Azure Data Factory (ADF), and Azure Functions.
- Proven experience working with Azure Data Lake or Azure Blob Storage.
- Strong knowledge of SQL Server and Logic Apps.
- Degree in Computer Science or an equivalent field.
- Experience working within an Agile delivery methodology.
- Excellent written and verbal communication skills.
Preferred Qualifications
- Experience with client management and stakeholder coordination.
- Ability to work independently to implement complex requirements using Spark notebooks.
Benefits
- Opportunities to work on inspiring and meaningful projects with global scale.
- Access to coaching, feedback, and continuous education to support personal development.
- Individual progression plans to help you control your career path.
- A flexible working environment that emphasizes high quality and knowledge exchange.
About the Company
EY is a global leader in assurance, consulting, law, strategy, tax, and transactions. Our Data and Analytics team helps clients solve complex business challenges by extracting value from data across industries such as Banking, Healthcare, Manufacturing, and Finance. We are dedicated to building a better working world through innovation and technology.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeAzure Data Engineer - Senior
EY · Hyderabad
