Senior Data Scientist, AI & Model Risk

Responsibilities

• Lead end-to-end AI Risk Assessments for generative AI and LLM use cases across the Bank
• Review AI system design and documentation including retrieval sources, guardrail configurations, and change management
• Assess pre-deployment testing for output integrity, hallucination detection, bias, and safety guardrails
• Evaluate ongoing monitoring plans for accuracy, drift detection, and reliability metrics
• Develop and maintain templates, tools, and procedures to support the AI Risk Governance Program
• Monitor the evolving regulatory landscape for AI in banking and incorporate emerging guidance

Requirements

• Minimum 5 years of related experience with a Bachelor’s degree in a quantitative field (or equivalent combination of education and experience)
• Proficiency in Python or similar languages for evaluating AI system behavior and analyzing model outputs
• Strong understanding of generative AI architectures including LLMs, transformer models, RAG systems, and agentic AI
• Understanding of interagency model risk management principles, including SR 26-2
• Knowledge of AI testing methodologies such as functional, bias, and adversarial testing
• Excellent written and verbal communication skills to translate technical AI concepts for non-technical stakeholders

Preferred Qualifications

• Master's degree in AI/ML, Cybersecurity, Data Science, or a related field
• Familiarity with AI governance frameworks like NIST AI RMF or ISO 42001
• Experience with explainability tools such as SHAP or LIME
• Certifications such as CRISC, PRM, FRM, or AI-specific practitioner certifications
• Prior experience in a second-line-of-defense or internal audit role at a financial institution

About the Company

Block is building technology to increase access to the global economy through brands like Square, Cash App, Afterpay, TIDAL, and Bitkey.