Staff Backend Software Engineer- (AI Platform)

Highlights

• Design core systems powering Databricks Model Serving at global scale.
• Deliver real-time, low-latency inference for ML and large language models.
• Improve latency, availability and cost-efficiency of serving workloads.

What they offer

• annual performance bonus
• equity
• comprehensive benefits and perks

Ideal candidate

Seasoned distributed systems leader with 10+ years of experience who thrives owning large-scale inference platforms. Strategic, product-minded collaborator passionate about performance, reliability, and mentoring engineers.

Requirements

• 10+ years of experience building and operating large-scale distributed systems
• Deep expertise in model serving, inference systems, and related infrastructure
• Strong foundation in algorithms, data structures, and system design for low-latency serving systems
• Proven ability to deliver technically complex, high-impact initiatives
• Experience leading architecture for large-scale, performance-sensitive CPU/GPU inference systems
• Strong communication skills and ability to collaborate across teams
• Strategic and product-oriented mindset
• Passion for mentoring engineers and fostering technical excellence