Senior Software Engineer - AI Platform

Responsibilities

• Build and operate the LLM control plane and gateway, including smart routing, rate limiting, failover, and cost tracking.
• Develop unified APIs and SDKs (REST/gRPC) with normalized schemas, caching, and full observability.
• Design and manage agent orchestration patterns, tool registries, and long-running workflows.
• Implement safety and privacy guardrails, including content filtering and PII redaction.
• Build and maintain MLOps pipelines for both classical ML models and deep learning systems.
• Evolve the domain graph and entity resolution to power hybrid retrieval (graph, vector, and keyword search).
• Define and maintain SLOs for latency, uptime, and cost, while enabling autoscaling and spend controls.

Requirements

• 5+ years of experience building large-scale data, ML, or platform systems.
• Proficiency in Python and at least one of Java, Scala, or Go.
• Strong experience with microservices architecture and API design.
• Hands-on MLOps experience using tools like Airflow, Kubeflow, or MLflow.
• Experience with cloud infrastructure (AWS preferred) and container orchestration (Docker/Kubernetes).
• Practical knowledge of graph databases (e.g., Neo4j) and vector search technologies.

Preferred Qualifications

• Experience building or operating an LLM gateway or control plane.
• Expertise in agentic systems, including function calling and orchestration frameworks.
• Experience with real-time data processing using Spark, Flink, or Kafka.
• A "platform-as-a-product" mindset with a focus on developer experience and clear SLAs.

About the Company

Tekion is disrupting the automotive industry with the first cloud-native automotive platform. By connecting the entire ecosystem—including OEMs, retailers, and consumers—through a seamless, AI-driven platform, Tekion is enabling the best automotive retail experiences ever. We employ nearly 3,000 people across North America, Asia, and Europe.