
Posted 7 hours ago
Prompt Engineer
Medfar
Requirements
5+ years in AI/ML or related field, 2+ years in prompt engineering, Experience with modular prompt architectures, Familiarity with OpenAI, Anthropic, or Google APIs, Fluent in English and French
Skills
LLMPythongenerative AILangChainNLPRAG
About the role
Responsibilities
- Audit and re-architect monolithic prompts into modular, maintainable chains
- Lead the selection and evaluation of language models to optimize quality and cost
- Ensure the quality of clinical outputs generated by AI through structured validation
- Evolve and realign existing evaluation frameworks for clinical note quality
- Establish systematic validation approaches, including regression testing for prompt changes
- Design and implement new prompts and evaluation suites for CoeurWay and MYLE EMR
- Mentor future prompt designers and contribute to hiring decisions
- Maintain internal documentation and best practices for prompt engineering
- Stay updated on the evolving LLM landscape and share findings with the team
- Collaborate with the GenAIOps team to ensure prompts are production-ready via CI/CD
Requirements
- Minimum 5 years of professional experience in AI/ML, product development, or computational linguistics
- Minimum 2 years of practical experience in prompt engineering with production LLM systems
- Demonstrated experience decomposing complex prompts into modular architectures (chaining, routing, etc.)
- Experience designing or improving evaluation frameworks for LLMs
- Strong familiarity with commercial generative model APIs (OpenAI, Anthropic, Google)
- Advanced proficiency in English (written and spoken)
- Fluency in French is required for client interactions
Preferred Qualifications
- Experience in health information technology or clinical documentation
- Understanding of clinical note structures and relevance
- Experience with automated evaluation approaches using LLM-based judges
- Proficiency in Python or other programming languages for building evaluation pipelines
- Experience with self-hosted or open-weight models
About the Company
MEDFAR Solutions Cliniques was founded in 2010 to leverage technology within healthcare systems. MEDFAR was the first company in Canada to certify a cloud-based Electronic Medical Record (MYLE), providing unique care management solutions for clinics worldwide.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freePrompt Engineer
Medfar · Montreal
