Software Engineer I

Responsibilities

• Build and run the LLM control plane/gateway including smart routing, rate limits, and cost tracking
• Ship unified APIs and SDKs using REST/gRPC with full observability
• Enforce safety and privacy through content filtering and PII redaction
• Enable multi-model and multi-vendor LLM usage with automated canarying
• Own the agent runtime including tool registry, function calling, and retrieval
• Design orchestration patterns and manage agent state and workflows
• Enable platform components for classical ML training and scoring pipelines
• Monitor model and data drift to maintain accuracy
• Evolve the domain graph and build reliable data ingestion pipelines
• Power retrieval with hybrid search (graph, vector, and keyword)
• Define SLOs for latency, uptime, and cost

Requirements

• 2+ years building large-scale data, ML, or platform systems
• Strong software engineering fundamentals in distributed systems and API design
• Production experience with Python and one of Java, Scala, or Go
• Experience with MLOps at scale (Airflow, Kubeflow, MLflow, Spark, or Kafka)
• Proficiency with AWS, Docker, and Kubernetes
• Practical knowledge of feature engineering, training, and evaluation
• Experience with knowledge graphs (Neo4j, Neptune) or vector search (pgvector, Qdrant, Milvus)

Preferred Qualifications

• Experience building or operating an LLM gateway or control plane
• Experience with agentic systems, tool use, and orchestration frameworks
• Strong focus on developer experience and platform-as-a-product mindset

About the Company

Tekion is disrupting the automotive industry with the first cloud-native automotive platform, connecting the entire ecosystem through cutting-edge technology, big data, and AI.