Senior Software Engineer, Model Serving

Responsibilities

• Design and implement core systems and APIs that power Databricks Model Serving
• Drive architectural decisions to optimize performance, throughput, and autoscaling for CPU and GPU workloads
• Contribute to serving infrastructure including model container builds, deployment workflows, routing, caching, and observability
• Collaborate cross-functionally with product, platform, and research teams
• Lead technical initiatives to improve latency, availability, and cost-effectiveness
• Establish best practices for code quality, testing, and operational readiness while mentoring other engineers

Requirements

• 5+ years of experience building and operating large-scale distributed systems
• Experience in model serving, inference systems, or related infrastructure
• Strong foundation in algorithms, data structures, and system design
• Proven ability to deliver complex, high-impact technical initiatives
• Experience building architecture for performance-sensitive CPU/GPU inference systems
• Strong communication and collaboration skills
• Customer-focused mindset

About the Company

Databricks is the data and AI company. More than 10,000 organizations worldwide rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.