Software Engineering Director - Inference Platform

Highlights

• Lead inference serving platform for foundation models on RDU hardware.
• Own deployment, orchestration, scaling and reliability for production AI.
• Build rack-scale systems optimized for agentic and long-running workloads.

What they offer

• Equity included in total rewards package
• 95% employee medical premium coverage, 77% for dependents
• Health Savings Account (HSA) with employer contribution
• Dental, Vision and Flexible Spending Account options
• Short/Long-term Disability, Basic and Voluntary Life, AD&D insurance
• Headspace subscription and Gympass+ membership
• One Medical membership and Employee Assistance Program

Ideal candidate

Hands-on engineering leader who energizes teams while diving into hard scaling and reliability problems. You thrive in fast-paced AI infrastructure and care about technical excellence, mentorship, and shipping robust production platforms.

Requirements

• 12+ years of software engineering experience, including 2+ years leading and managing engineering teams
• Demonstrated ability to manage, develop, and hire strong engineers while remaining hands-on
• Strong technical depth in backend systems built with Python, Go, or Rust
• Experience with AI inference serving, orchestration, and LLM workloads at production scale
• Proven ability to drive engineering excellence across a team
• Excellent communication skills with engineers, partners, and senior leadership
• Experience running iterative engineering processes in a fast-paced environment
• Experience with Kubernetes ecosystem tooling, including Operators and Helm Charts
• Background in ML application optimization and productionization
• Experience building cloud-native platforms for enterprise customers