Staff AI Engineer

About the Company

Hippocratic AI is the leading generative AI company in healthcare. We have trained our own LLMs as part of our Polaris constellation, resulting in a system with over 99.9% accuracy, designed to transform patient outcomes at a global scale.

Responsibilities

• Architect and own production-grade AI pipelines including RAG, multi-step reasoning, agent orchestration, and evaluation systems
• Lead cross-functional initiatives with product, clinical, and engineering teams to translate healthcare workflows into safe AI experiences
• Drive zero-to-one bets using state-of-the-art LLMs, retrieval systems, and streaming architectures
• Set the standard for AI-native workflows and own the safety and evaluation bar across model evaluation and observability
• Mentor senior and mid-level engineers and raise the quality bar through code and design reviews

Requirements

• BS in Computer Science or equivalent
• 6+ years of professional experience in software, ML, or AI engineering
• Proven track record building and shipping AI- or ML-powered products in production
• Strong programming skills in Python
• Experience with distributed systems, APIs, and data pipelines
• Deep understanding of prompt engineering, vector databases, and retrieval systems (RAG)
• Experience with cloud environments (AWS/GCP/Azure) and modern DevOps practices

Preferred Qualifications

• Experience building or deploying LLM-based or multi-agent systems at scale
• Hands-on work with speech recognition, text-to-speech, or streaming architectures
• Prior exposure to healthcare, safety-critical domains, or regulated product development