Senior Software Engineer, Model Serving

Highlights

• Build real-time, low-latency inference powering enterprise AI at massive scale.
• Shape core serving architecture to optimize performance, throughput and efficiency.
• Operationalize traditional ML and proprietary LLMs with governance and lineage.

What they offer

• annual performance bonus
• equity
• comprehensive benefits

Ideal candidate

Customer-focused distributed systems builder who thrives in fast-moving teams, cares about latency and reliability at scale, and enjoys mentoring others toward technical excellence.

Requirements

• 5+ years building and operating large-scale distributed systems
• Experience in model serving, inference systems or related infrastructure
• Strong foundation in algorithms, data structures and system design for low-latency serving
• Proven ability to deliver complex, high-impact initiatives with measurable value
• Experience architecting performance-sensitive CPU/GPU inference systems
• Strong communication and cross-functional collaboration in fast-moving environments
• Customer-focused mindset aligning implementation with product goals
• Passion for mentoring engineers and fostering technical excellence