Senior Applied AI Engineer

Responsibilities

• Ship production agentic systems including prompts, tools, retrieval, guardrails, and observability
• Automate SME workflows by identifying operational toil and replacing it with AI systems
• Own the evaluation loop, golden datasets, offline evals, and online metrics
• Design for compliance frameworks like COPPA and FERPA to ensure AI safety and bias control
• Hand off production features with documentation, runbooks, and eval harnesses
• Create internal libraries and playbooks to enable other engineering teams to build AI features

Requirements

• 7+ years of professional software engineering experience
• 1+ years of hands-on experience building agentic systems in production
• Proficiency in Python and one typed language (TypeScript, Go, etc.)
• Experience with cloud platforms (AWS or GCP) and containerized deployment
• Practical knowledge of agentic patterns like ReAct, tool use, and prompt chaining
• Hands-on experience with retrieval (chunking, embeddings, hybrid search, re-ranking)
• Strong prompt engineering skills (zero-shot, few-shot, chain-of-thought)
• Disciplined approach to evaluation and structured output validation

Preferred Qualifications

• Advanced retrieval experience with GraphRAG or agentic retrieval
• Experience with safety, privacy, and policy constraints in regulated domains (K-12)
• Experience with prompt-optimization frameworks like DSPy or AdalFlow
• Open-source contributions to AI tooling or a public repository of meaningful AI work

About the Company

Level is a learning technology company dedicated to helping students build real academic and life skills with confidence and joy through interactive design and proven curriculum principles.