Staff Engineer, Systems and Reliability
LiteLLM · San Francisco
InfrastructureonsiteStaff$250k–$350k
At a glance
Highlights
- Own reliability of AI gateway powering production AI for thousands of companies.
- Lead rewrites of core gateway code to eliminate recurring regressions for good.
- Ship in open source used by engineering teams around the world daily.
What they offer
- Equity
- Health, dental, and vision benefits
- Relocation assistance
Ideal candidate
First-principles engineer who has owned mission-critical production systems and cares deeply about reliability and customer impact. You dive into unfamiliar code to find root causes and raise quality through your own work.
Requirements
- 3+ years of experience with fast rise in scope at a strong engineering company
- Owned stability or reliability at current company
- Owned mission-critical systems in production and led rewrites or migrations
- Able to walk into unfamiliar codebase and find real root cause
- First-principles thinker who reviews AI-written code carefully
- Customer empathy and considers user impact before shipping
- Strong software engineering fundamentals, preferably in Python
- visa sponsorship
- H-1B transfers supported
Lab profile
About LiteLLM
Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.
What they build
- AI Gateway
- Unified LLM API
Known for
- World's most popular AI gateway
- Trusted by Adobe, Netflix and NASA
- Secure, reliable LLM access
- Routing, spend control and usage monitoring
Posted · Last seen