Senior AI Engineer

Responsibilities

• Architect and optimize high-performance, asynchronous orchestration layers using FastAPI and inference servers like vLLM or Triton.
• Build advanced semantic caching layers and dynamic routing engines to dispatch prompts to the most cost-effective or lowest-latency models.
• Operationalize and maintain consistent deployments across multiple geographical regions and asymmetrical environment topologies.
• Implement enterprise-grade observability, rate-limiting, and telemetry dashboards using Prometheus and Grafana to track token consumption and system metrics.

Requirements

• Bachelor's or Master's Degree in Computer Science or a related field.
• 6–8 years of experience in backend platform engineering, systems architecture, or MLOps/LLMOps infrastructure design.
• Expert-level Python skills with deep experience in concurrent and asynchronous programming (FastAPI, Asyncio).
• Hands-on experience with AI/LLM infrastructure, including AWS Bedrock, prompt/model routing, and hosting Hugging Face models.
• Proficiency with AWS services (EKS, IAM, VPC) and containerization technologies (Docker, Kubernetes).

About the Company

Cornerstone powers the potential of organizations and their people to thrive in a changing world. Through Cornerstone Galaxy, our AI-powered workforce agility platform, we help over 7,000 organizations identify skills gaps, retain top talent, and provide multimodal learning experiences to a global workforce of over 100 million users.