Staff Backend Software Engineer

Responsibilities

• Design and implement core systems and APIs that power Databricks Model Serving
• Partner with product and engineering leadership to define technical roadmaps and long-term architecture
• Drive architectural decisions to optimize performance, throughput, and autoscaling for CPU and GPU workloads
• Contribute to serving infrastructure including model container builds, deployment workflows, routing, caching, and observability
• Lead technical initiatives to improve latency, availability, and cost-effectiveness
• Mentor engineers through design reviews and technical guidance

Requirements

• 10+ years of experience building and operating large-scale distributed systems
• Deep expertise in model serving, inference systems, and related infrastructure
• Strong foundation in algorithms, data structures, and system design
• Proven ability to deliver complex, high-impact technical initiatives
• Experience leading architecture for performance-sensitive CPU/GPU inference systems
• Strong communication and cross-team collaboration skills

About the Company

Databricks is the data and AI company. More than 10,000 organizations worldwide rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.