Analyst/Sr Analytics & Modeling Analyst

Responsibilities

• Support the validation, evaluation, and governance of advanced AI systems, including Machine Learning, Generative AI (GenAI), and Agentic AI models.
• Execute hands-on validation and testing of AI models following established evaluation frameworks.
• Develop and run systematic model evaluations to benchmark performance and safety using industry leaderboards and LLM-as-a-judge frameworks.
• Assess AI system risks, focusing on accuracy, bias, explainability, and operational integrity.
• Collaborate with technology, risk, compliance, and business stakeholders to ensure alignment with regulatory standards.
• Maintain high standards of documentation and communicate validation results to both technical and non-technical audiences.

Requirements

• 4+ years of experience in machine learning.
• Strong expertise in GenAI, Agentic AI, and LLM evaluation frameworks.
• Proficiency in Python and SQL.
• Experience with NLP, prompt engineering, and RAG.
• Bachelor's or Master's degree in Computer Science, Mathematics, Financial Engineering, or a related quantitative field.
• Solid understanding of AI risk management and responsible AI practices.

Preferred Qualifications

• Hands-on experience building tools to test the performance, safety, and reliability of LLM-based applications.
• Experience with cloud deployment (AWS or Azure).
• Experience working in regulated or financial domains such as corporate finance, credit, or debt markets.

About the Company

Moody's is a global leader in ratings and integrated risk assessment. We are transforming how the world sees risk by advancing AI to move from insight to action, helping our clients navigate uncertainty with clarity, speed, and confidence.