Staff Quality Engineer - AI SOC

Responsibilities

• Create and extend software frameworks and tools to execute, monitor, and report on automated tests
• Build and maintain automation frameworks and CI/CD pipelines
• Architect and design automation solutions for API validation, performance testing, load testing, and fuzz testing
• Develop testing frameworks for generative AI and machine learning applications, including hallucination detection and prompt-response consistency
• Implement evaluation pipelines to measure LLM accuracy, latency, bias, and reliability
• Collaborate with software engineering teams to improve engineering quality and testing methodologies

Requirements

• 8+ years of experience in software delivery and high-quality software solutions
• Expertise in cloud computing platforms such as AWS, Azure, or GCP
• Proven experience building automation frameworks and CI/CD pipelines
• Strong knowledge of distributed systems and microservices architectures
• Expertise in functional, load, and fuzz testing (e.g., Locust, CATS)
• Strong programming, debugging, and problem-solving skills

Preferred Qualifications

• Experience testing artificial intelligence or machine learning applications
• Familiarity with large language model evaluation techniques and prompt engineering
• Experience working within cybersecurity or cloud-native environments
• Experience building scalable testing infrastructure for distributed systems

Benefits

• Equity for all employees
• Flexible annual leave, paid holidays, and volunteer days
• Training and career development programs
• Comprehensive private benefits plan including medical insurance for you and your family
• Life insurance and personal accident insurance
• Fertility support and paid parental leave

About the Company

Arctic Wolf is a leader in the cybersecurity industry, dedicated to the mission of ending cyber risk. We build award-winning technology, such as the Aurora Platform, to protect organizations worldwide. Our global team thrives on solving complex problems and delivering real outcomes for customers through continuous innovation in security operations.