Forward Deployed ML Engineer at division50 - ScoutJobs - The AI-curated global job board
Skip to content
division50
Posted 23 days ago

Forward Deployed ML Engineer

division50Forward Deployed ML Engineer

Requirements

2+ years building ML/AI in production, Built AI agents or multi-step LLM pipelines, Strong Python, Prompt engineering, Fine-tuning, RAG, Eval design, Evaluation frameworks for LLM document extraction

Skills

PythonLLMRAG

About the role

Responsibilities

  • Build and deploy AI agent pipelines to extract structured oncology variables from unstructured patient documents
  • Own the full development cycle: studying clinical source documents, building extraction agents, and evaluating accuracy
  • Design and implement evaluation frameworks for LLM-based document extraction
  • Deploy models to production and iterate based on real-world performance and customer data dictionaries
  • Work closely with customers to ensure high-accuracy delivery in high-intensity sprints

Requirements

  • 2+ years of experience building ML/AI models in a production environment
  • Proven experience building AI agents or multi-step LLM pipelines
  • Strong proficiency in Python
  • Deep expertise in prompt engineering, fine-tuning, RAG, and evaluation design
  • Experience with evaluation frameworks specifically for LLM document extraction
  • Comfort in customer-facing roles and a willingness to become an oncology-domain expert

Preferred Qualifications

  • Deep knowledge of the current agentic ML landscape
  • Experience with clinical or biomedical Natural Language Processing (NLP)

About the Company

Our partner is building the agentic AI layer for oncology EHRs. They replace manual clinical workflows with task-driven AI agents that process pathology reports, clinical notes, and genomic panels at scale. Their platform is trusted by four of the top 10 Best Hospitals for Cancer and processes millions of oncology medical documents monthly.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Forward Deployed ML Engineer

division50 · New York

Sign up to apply