AI Evaluations & Red Team Lead

Responsibilities

• Define and evolve the AI evaluation strategy aligned to FNZ's six-pillar framework, covering performance, safety, compliance, and robustness.
• Establish evaluation standards, methodologies, and scoring criteria to be integrated into the SDLC as mandatory release gates.
• Represent the evaluations function in the AI Governance Committee, providing critical risk assessments and release recommendations.
• Build, mentor, and manage a team of evaluation specialists across generalist and specialist roles.
• Design and execute complex evaluations for high-risk AI agents and lead red teaming exercises for critical deployments.
• Communicate evaluation findings to both technical and non-technical stakeholders to influence product roadmaps.

Requirements

• 7-12 years of experience in AI/ML engineering, quality assurance, or security testing.
• 3+ years of dedicated experience in AI evaluation or red teaming.
• Deep understanding of LLM-based agents, RAG architectures, and agentic AI systems.
• Strong programming background with real-world experience developing evaluation solutions for agents.
• Proven ability to design evaluation methodologies for probabilistic AI systems.
• Experience working within regulated industries such as financial services or healthcare.
• Demonstrated leadership experience managing cross-functional teams and influencing stakeholders.

About the Company

FNZ is committed to opening up wealth so that everyone, everywhere can invest in their future on their terms. We provide a global, end-to-end wealth management platform that integrates modern technology with business and investment operations within a regulated financial institution. We partner with the world’s leading financial institutions, managing over US$2.4 trillion in assets on platform (AoP) to empower nearly 30 million people globally.