
Posted 18 hours ago
Data Engineer
World Bank
Requirements
Master's degree with 5 years experience or Bachelor's with 7 years experience, Expertise in scalable data pipelines, Knowledge of data modeling and algorithms, Experience with Databricks and modern data lake architectures, Proficiency in DevOps principles, Experience in Agile/SAFe environments
Skills
Apache SparkPySparkSQLDatabricksETLDevOps
About the role
Responsibilities
- Design, develop, and maintain scalable data pipelines for ingestion, transformation, and serving across batch and streaming workloads
- Build ETL/ELT workflows to integrate data from diverse sources into enterprise data platforms using Apache Spark, PySpark, and SQL
- Implement medallion architecture patterns (bronze, silver, gold) and develop dimensional models for analytics use cases
- Support federated data pipeline architecture to enable Line of Business teams to manage their own domain data
- Develop reusable pipeline templates, Infrastructure as Code (IaC) patterns, and standardized blueprints for data products
- Implement data quality checks, automated testing, and observability tools to ensure data freshness and reliability
- Prepare and serve data for machine learning, AI workloads, and business intelligence tools like Power BI and Tableau
- Collaborate with data architects, scientists, and platform engineers to align development with enterprise standards
Requirements
- Master's degree with 5 years of relevant experience, or a Bachelor's degree with at least 7 years of experience
- Expertise in designing and optimizing scalable data pipelines and data processing solutions
- Advanced experience with Databricks and modern data lake architectures
- Strong knowledge of data modeling, data structures, and algorithms
- Proficiency in applying DevOps principles, including automation and continuous improvement
- Experience working in Agile environments, specifically within the Scaled Agile Framework (SAFe)
- Strong communication and stakeholder management skills to work across technical and non-technical teams
Preferred Qualifications
- SAFe Product Owner/Product Manager (PO/PM) certification or other relevant Agile certifications
- Industry-recognized certifications in Data Engineering, Data Analytics, or Cloud Technologies
Benefits
- Comprehensive retirement plan
- Medical, life, and disability insurance
- Paid leave, including parental leave
- Reasonable accommodations for individuals with disabilities
About the Company
The World Bank Group is a unique global partnership of five institutions dedicated to ending extreme poverty, increasing shared prosperity, and promoting sustainable development. With 189 member countries and over 130 offices worldwide, we invest in groundbreaking projects and use data, research, and technology to develop solutions to the most urgent global challenges.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
World Bank · Chennai
