Staff Software Engineer, Model Serving

Responsibilities

• Design and implement core systems and APIs that power Databricks Model Serving, ensuring scalability, reliability, and operational excellence
• Partner with product and engineering leadership to define the technical roadmap and long-term architecture for serving workloads
• Drive architectural decisions to optimize performance, throughput, autoscaling, and operational efficiency for CPU and GPU workloads
• Contribute to key components including model container builds, deployment workflows, routing, caching, and observability
• Lead technical initiatives to improve latency, availability, and cost-effectiveness
• Mentor other engineers through design reviews and technical guidance

Requirements

• 10+ years of experience building and operating large-scale distributed systems
• Deep expertise in model serving, inference systems, and related infrastructure
• Strong foundation in algorithms, data structures, and system design
• Proven ability to deliver technically complex, high-impact initiatives
• Experience leading architecture for performance-sensitive CPU/GPU inference systems
• Strong communication and cross-team collaboration skills

About the Company

Databricks is the data and AI company. More than 10,000 organizations worldwide rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.