Senior Machine Learning Engineer

Responsibilities

• Build and operate the LLM control plane and gateway, including smart routing, rate limiting, failover, and cost tracking.
• Develop unified APIs and SDKs (REST/gRPC) with normalized schemas, caching, and full observability.
• Implement safety and privacy guardrails such as content filtering, prompt validation, and PII redaction.
• Own the agent runtime, managing tool registries, permissions, function calling, and orchestration patterns.
• Design and maintain MLOps pipelines for both classical ML models and deep learning systems.
• Evolve the domain graph and entity resolution to power hybrid retrieval (graph, vector, and keyword search).
• Define and monitor SLOs for latency, uptime, and cost while enabling autoscaling and spend controls.

Requirements

• 5+ years of experience building large-scale data, machine learning, or platform systems.
• Production experience with Python and at least one of Java, Scala, or Go.
• Hands-on experience with MLOps pipelines (Airflow, Kubeflow, or MLflow) and CI/CD for models.
• Expertise in cloud environments (AWS preferred) and containerization using Docker and Kubernetes.
• Practical knowledge of LLM gateways, agentic orchestration, and tool-use frameworks.
• Experience with graph databases (e.g., Neo4j, Neptune) and vector search (e.g., Milvus, Qdrant, pgvector).

Preferred Qualifications

• Experience with real-time data processing using Spark, Flink, or Kafka.
• Strong understanding of distributed systems, concurrency, and abstracted API design.
• A "platform-as-a-product" mindset with a focus on developer experience and clear SLAs.
• Experience implementing human-in-the-loop review systems for AI agents.

About the Company

Tekion is disrupting the automotive industry with the first cloud-native automotive platform. By connecting the entire ecosystem—including OEMs, retailers, and consumers—through a seamless, AI-driven platform, Tekion is enabling the best automotive retail experiences ever. We employ close to 3,000 people across North America, Asia, and Europe.