Senior AI Engineer

Responsibilities

• Design and implement multi-agent and agentic orchestration frameworks using agent SDKs
• Build and maintain MCP servers and integrations to extend AI system capabilities
• Build and optimize RAG pipelines including embedding strategies and vector databases
• Integrate with managed LLM services across cloud providers for cost optimization
• Fine-tune, optimize, and deploy open-source deep learning models using GPU infrastructure
• Design and implement automated evaluation frameworks to assess LLM system quality
• Architect and manage high-throughput, real-time data pipelines using Kafka
• Design, deploy, and scale production AI services on AWS using modern containerization and CI/CD
• Implement observability frameworks using Datadog to track token usage and latency

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
• 5+ years of experience as an AI Engineer, Machine Learning Engineer, or applied AI practitioner
• Deep Python expertise with a track record of shipping production systems at scale
• Hands-on experience designing and deploying LLM-driven or GenAI applications
• Experience with GPUs for model training or inference using PyTorch or TensorFlow
• Practical experience with cloud-based deployments and infrastructure tools like AWS and Docker
• Strong problem-solving and systems thinking skills

About the Company

Octus is a leading global provider of credit intelligence, data, and analytics. Since 2013, tens of thousands of professionals across hedge fund, investment banking, management consulting, and law firm verticals have come to rely on Octus to make better, faster, and more confident decisions in pace with the fast-moving credit markets.