Senior AI Engineer

Responsibilities

• Design and implement AI-powered features including LLM workflows, copilots, and agent-based systems
• Own the full lifecycle from prototyping and evaluation to production deployment and iteration
• Build and optimize prompt pipelines, retrieval systems, and RAG-based workflows
• Design agentic workflows capable of multi-step reasoning, planning, and execution
• Run structured experiments to compare prompting, retrieval, and model approaches
• Define and track key metrics for AI performance such as quality, latency, and cost
• Design guardrails to ensure safe AI behavior and mitigate hallucinations or prompt injection
• Implement monitoring and observability for AI systems in production

Requirements

• 4+ years of related work experience
• Strong understanding of LLM capabilities and limitations
• Experience with prompt engineering and structured output design
• Hands-on experience with embeddings and vector search
• Familiarity with RAG architectures
• Experience designing agent-based architectures and tool use
• Solid backend and system design fundamentals
• Ability to debug complex, non-deterministic system behaviors

Preferred Qualifications

• Experience evaluating agent performance across multi-step tasks
• Ability to translate user needs into effective AI solutions
• Strong intuition for balancing quality, latency, and cost

About the Company

Florence software advances cures by helping the world’s most important research sites do their best work. Their solutions are used by over 30,000 research teams in 70 countries to accelerate the pace at which new medicines get to market.