Posted 16 hours ago
Software Engineer - Infrastructure
Julius AISoftware Engineer - Infrastructure
Perks & benefits
Health InsuranceCommissionRelocation AllowanceVisa
Requirements
Production Kubernetes, Docker/containerd, Networking fundamentals, AWS/GCP/Azure, Terraform/Helm, Prometheus/Grafana, Container security
Skills
KubernetesDockerTerraformAWSGCP
About the role
About the Company
Julius is an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage.
Responsibilities
- Design and operate secure, multi-tenant container infrastructure with fast startup and smart autoscaling
- Ship cloud deployments using Helm and Terraform with SSO, network controls, and audit logging
- Drive observability through metrics, traces, and logs with clear SLOs
- Lead incident response
- Optimize images, scheduling, networking, and cost
- Build fair-use and rate-limiting controls
Requirements
- Production Kubernetes and container internals (Docker/containerd)
- Strong networking fundamentals
- Cloud experience (AWS/GCP/Azure)
- Infrastructure as Code (Terraform/Helm)
- Monitoring and Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector)
- Security best practices for containerized, multi-tenant systems
Preferred Qualifications
- Experience with gVisor, Kata, or Firecracker
- Experience with Cilium or eBPF
- GPU scheduling experience
- Serverless autoscaling (KEDA, Knative, or Karpenter)
- Experience building AI side projects
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSoftware Engineer - Infrastructure
Julius AI · San Francisco
