QA Automation Engineer – GenAI

Responsibilities

• Design and execute detailed test strategies, test plans, and test cases
• Build and maintain automation frameworks using Pytest, Selenium, or similar tools
• Conduct functional, integration, performance, and security testing
• Perform thorough API testing using Postman or comparable tools
• Collaborate with DevOps to integrate test automation into CI/CD pipelines
• Validate AI/ML and GenAI solutions by testing model accuracy, fairness, and robustness
• Detect bias and ensure input/output data quality for AI models
• Manage and track defects using JIRA and provide mentorship to junior QA engineers

Requirements

• 7+ years of hands-on experience in QA and automation engineering
• Proficiency with automation tools such as Pytest or Selenium
• Strong skills in API testing
• Knowledge of CI/CD integration
• Solid understanding of software testing methodologies and the full testing lifecycle
• Experience with both functional and non-functional testing
• Excellent communication and team collaboration skills
• Must be based in the UAE for this onsite role in Abu Dhabi

Preferred Qualifications

• Experience testing AI/ML and GenAI systems, including model validation and bias detection
• Experience with feature and data pipeline testing
• Familiarity with cloud platforms such as AWS, Azure, or GCP

About the Company

NorthBay Solutions is a global digital transformation company and an AWS Premier Consulting Partner. We deliver innovative cloud-native and AI/ML-powered solutions to solve complex business challenges. Our team of over 350 experts specializes in cloud migration, data modernization, and advanced analytics for industries including financial services, healthcare, and retail.