Principal AI Engineer

About the Company

Gorgias is an AI-first company building products powered by LLMs and agent-based systems. We are building the platform for Conversational Commerce, creating a unified AI agent that sells, supports, and re-engages customers across the entire ecommerce journey.

Responsibilities

• Architect and lead the development of an internal automated evaluation platform
• Design tools and workflows to reduce time-to-market for production-ready agents
• Partner with Orchestration teams to build scalable infrastructure for agentic simulations
• Serve as the AI Technical Lead for product squads, guiding agent design and prompting best practices
• Define engineering metrics to translate non-deterministic AI behavior into predictable outcomes
• Mentor engineers on applying rigorous system design to LLMs and agents
• Ensure production insights from agents inform the next iteration of evaluation datasets

Requirements

• 8+ years of high-scale engineering experience
• Deep experience with multi-stage AI orchestrations (agents, chained workflows, or custom runtime logic)
• Experience with distributed systems and event-driven architectures
• Proficiency in backend development, preferably Python
• Familiarity with tools like Kafka, Pub/Sub, or equivalent
• Hands-on experience with LLMs, including prompting, RAG, and evaluation workflows
• Experience building APIs and scalable services
• Understanding of monitoring, observability, and system performance
• Experience with vector databases and semantic caching

Preferred Qualifications

• Background in internal platforms or developer tooling
• Experience building or using formal Evaluation frameworks