Staff Software Engineer, Foundational Model Serving

Responsibilities

• Design and implement core systems and APIs that power Databricks Foundation Model Serving
• Partner with product and engineering leadership to define technical roadmaps and long-term architecture
• Drive architectural decisions to optimize performance, throughput, and autoscaling for GPU workloads
• Contribute to serving infrastructure components including vLLM, SGLang, and token-based rate limiters
• Collaborate cross-functionally with product, platform, and research teams
• Establish best practices for code quality, testing, and operational readiness
• Mentor engineers through design reviews and technical guidance

Requirements

• 10+ years of experience building and operating large-scale distributed systems
• Experience leading high-scale operationally sensitive backend systems
• Strong foundation in algorithms, data structures, and system design
• Proven ability to deliver technically complex, high-impact initiatives
• Strong communication and collaboration skills
• Strategic and product-oriented mindset
• Passion for mentoring and fostering technical excellence

About the Company

Databricks is the data and AI company. More than 10,000 organizations worldwide rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.