Software Engineer

Responsibilities

• Design, build, and maintain agent APIs and applications for document understanding and high-value features
• Evaluate and integrate open-source models to power production-ready agent features
• Develop reference agent applications to showcase workflows and accelerate customer adoption
• Collaborate with backend and infrastructure teams to integrate agents with deployment, orchestration, and monitoring systems
• Ensure APIs are robust, developer-friendly, and enterprise-ready
• Improve the reliability, scalability, and performance of agent features in production

Requirements

• 3+ years of experience in software engineering (backend, ML systems, or API development)
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent
• Strong programming skills in Python and experience with Python frameworks
• Solid understanding of LLM workflows, agent patterns, or tool invocation systems
• Experience designing and delivering production APIs
• Familiarity with open-source LLMs and multimodal models (HuggingFace, LangChain, LlamaIndex, etc.)
• Strong foundations in cloud-native development

Preferred Qualifications

• Experience with document understanding pipelines (OCR, RAG, summarization, structured extraction)
• Familiarity with Kubernetes or container orchestration in production
• Experience building or contributing to agent frameworks, SDKs, or CLIs
• Experience working in startup or fast-paced environments
• Passion for developer experience and enabling AI adoption

Benefits

• Flexible working hours
• Daily lunch and dinner provided; unlimited snacks and beverages
• Supportive and highly collaborative work environment
• Health check-up support and top-tier equipment/hardware support
• Competitive compensation, startup equity, and health insurance

About the Company

FriendliAI is building the world’s best AI inference platform that makes large language and multi-modal models fast, efficient, and deployable at scale.