Associate QA Automation Engineer (Databricks)

Responsibilities

• Own end-to-end data quality validation for Databricks batch pipelines across Bronze, Silver, and Gold layers using Medallion architecture.
• Validate data completeness, accuracy, consistency, and business-rule correctness using Databricks SQL and Delta tables.
• Design, develop, and maintain scalable, reusable data validation frameworks using PySpark and Python on Databricks.
• Automate integration, regression, and end-to-end testing for Databricks notebooks, workflows, and scheduled jobs.
• Define and implement test data management strategies, including data refresh, isolation, and masking.
• Manage test cases using Xray and track defects and sprint progress using Jira within an Agile/Scrum environment.
• Collaborate with data engineers, platform teams, and product owners to advocate for quality and communicate risks.

Requirements

• 2-5 years of experience in Software Quality Assurance or Data Quality Engineering.
• Strong hands-on experience with Databricks SQL and Databricks Python.
• Deep expertise in PySpark for data validation and test automation.
• Solid understanding of Medallion architecture (Bronze/Silver/Gold layers).
• Proficiency in Python and SQL.
• Mandatory experience with Xray for test management and Jira for defect tracking.
• Experience working in Agile/Scrum environments.

Preferred Qualifications

• Experience with Delta Lake (ACID transactions, schema evolution, time travel).
• Proficiency in French or Dutch.
• Exposure to data governance or enterprise data quality frameworks.
• Experience defining data quality metrics, KPIs, and dashboards.

About the Company

Moody's is a global leader in ratings and integrated risk assessment. We are transforming how the world sees risk by advancing AI to move from insight to action, helping our clients navigate uncertainty with clarity, speed, and confidence.