Senior Quality Engineer

Responsibilities

• Design and execute test strategies for AI/ML-enabled features and define acceptance thresholds
• Validate AI-generated outputs including mappings, anomaly flags, and LLM summaries
• Evaluate LLM outputs for accuracy, hallucination, and format compliance
• Write data validation logic in Python or SQL across Bronze, Silver, and Gold layers
• Implement automated validation checkpoints in Databricks pipelines
• Define and instrument production monitoring checks for model performance and data drift
• Perform functional, regression, integration, and exploratory testing
• Design and maintain automated test scripts using Katalon and Playwright
• Develop test cases for ETL processes, data warehouse workflows, and API validation
• Participate in Agile ceremonies and collaborate with cross-functional teams

Requirements

• Minimum 5 years of experience in software testing or quality engineering
• At least 2 years focused on data-intensive or AI/ML-enabled products
• Bachelor’s Degree in Computer Science, IT, MIS, or equivalent
• 3+ years of experience with Microsoft SQL Server
• 2+ years of API testing experience using Postman, Swagger, or SoapUI
• Experience writing and executing test cases for ETL processes and data warehouse environments
• Proficiency with Agile/Scrum methodologies

Preferred Qualifications

• Hands-on experience with Databricks, Delta Lake, or equivalent Lakehouse platforms
• Proficiency in Python for data validation
• Experience with LLM evaluation, prompt regression testing, or generative AI quality workflows
• Familiarity with dbt, Great Expectations, or MLflow
• Experience with automation frameworks like Katalon or Playwright
• CSQA or ISTQB certification

About the Company

M3 is a leading provider of hospitality-specific software solutions, delivering cloud-based tools for hotel accounting, financial reporting, labor management, payroll, and business intelligence.