Staff Backend Software Engineer

Responsibilities

• Design and implement core systems and APIs that power Databricks Model Serving
• Drive architectural decisions to optimize performance, throughput, and autoscaling for CPU and GPU workloads
• Contribute to serving infrastructure including model container builds, deployment workflows, routing, caching, and observability
• Collaborate cross-functionally with product, platform, and research teams
• Lead technical initiatives to improve latency, availability, and cost-effectiveness
• Establish best practices for code quality and mentor other engineers

Requirements

• 5+ years of experience building and operating large-scale distributed systems
• Experience in model serving, inference systems, or related infrastructure
• Strong foundation in algorithms, data structures, and system design
• Experience building architecture for performance-sensitive CPU/GPU inference systems
• Proven ability to deliver complex, high-impact technical initiatives
• Strong communication and collaboration skills

About the Company

Databricks is the data and AI company. More than 10,000 organizations worldwide rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.