Staff Engineer, AI
LiteLLM · San Francisco
InfrastructureonsiteStaff$250k–$350k
At a glance
Highlights
- Lead the unified API team keeping 100+ LLM providers working on day one.
- Own new model, endpoint and provider rollouts end to end at gateway level.
- Own developer experience for SDK and proxy used by thousands of teams.
What they offer
- Equity
- Health, dental, and vision benefits
- Relocation assistance
Ideal candidate
A former ML engineer now building applied AI who loves great developer experience, talks to customers before building, and wants to lead a core team from day one with a high quality bar.
Requirements
- 3+ years experience as ML engineer now building applied AI products
- Deep expertise in LLM APIs and provider nuances
- Experience building or maintaining a unified API across providers
- Strong Python engineering fundamentals with high code quality bar
- Ready to lead a team from day one and set technical direction
- Taste in developer experience and customer empathy
- remote policy
- Onsite only
- visa sponsorship
- H-1B transfers supported
Lab profile
About LiteLLM
Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.
What they build
- AI Gateway
- Unified LLM API
Known for
- World's most popular AI gateway
- Trusted by Adobe, Netflix and NASA
- Secure, reliable LLM access
- Routing, spend control and usage monitoring
Posted · Last seen