Staff Software Engineer - AI Engineer

Responsibilities

• Build and operate the LLM control plane and gateway, including smart routing, rate limiting, failover, and cost tracking.
• Develop unified APIs and SDKs (REST/gRPC) with normalized schemas, caching, and full observability.
• Enforce safety and privacy through content filtering, prompt validation, and PII redaction.
• Own the agent runtime, managing tool registries, permissions, function calling, and orchestration patterns.
• Design and maintain MLOps pipelines for both classical ML models and deep learning systems.
• Evolve the domain graph and entity resolution to power hybrid retrieval (graph, vector, and keyword search).
• Define and maintain SLOs for latency, uptime, and cost, while providing templates and documentation for product teams.

Requirements

• 8+ years of experience building large-scale data, ML, or platform systems.
• Proficiency in Python and at least one of Java, Scala, or Go.
• Extensive experience with MLOps pipelines (e.g., Airflow, Kubeflow, MLflow).
• Expertise in cloud environments (AWS preferred) and containerization (Docker, Kubernetes).
• Practical knowledge of LLM gateways, agentic orchestration, and tool use.
• Experience with graph databases (e.g., Neo4j, Neptune) and vector search (e.g., Milvus, Qdrant).

Preferred Qualifications

• Experience with real-time data processing using Spark, Flink, or Kafka.
• Strong understanding of distributed systems, concurrency, and abstracted API design.
• Experience building multi-tenant SaaS platforms with strict performance and cost guardrails.
• A "platform-as-a-product" mindset with a focus on developer experience and clear SLAs.

About the Company

Tekion is disrupting the automotive industry with the first cloud-native automotive platform. By connecting the entire ecosystem—including OEMs, retailers, and consumers—through a seamless, AI-driven platform, Tekion is enabling the best automotive retail experiences ever. We employ nearly 3,000 people across North America, Asia, and Europe.