Senior Machine Learning Engineer

About the Company

Hippocratic AI is the leading generative AI company in healthcare. We have trained our own LLMs as part of our Polaris constellation, resulting in a system with over 99.9% accuracy, designed to transform patient outcomes at a global scale.

Responsibilities

• Design and build evaluation frameworks for LLM safety, clinical accuracy, and conversational quality
• Develop synthetic data generation pipelines to stress-test models across diverse clinical scenarios
• Build automated and human-in-the-loop evaluation pipelines at scale
• Create benchmarks, metrics, and LLM-as-judge systems for healthcare tasks and conversational experience
• Analyze failure modes and translate findings into actionable model improvements
• Collaborate with research, engineering, and clinical teams to define and raise the quality bar

Requirements

• MS or PhD in CS or related field
• 5+ years in ML engineering, evaluation systems, or applied ML
• Strong software engineering skills in Python and PyTorch
• Hands-on experience with LLM evaluation, benchmarking, or synthetic data generation
• Experience building robust data analysis and evaluation infrastructure
• Experience with UI/UX toolkits such as Streamlit, Gradio, or React

Preferred Qualifications

• Experience in healthcare AI
• Experience with RL, RLVR, RLHF, or safety evaluation