Staff Backend Engineer
LiteLLM · San Francisco
Infrastructureonsitestaff$250k–$350k
At a glance
Highlights
- Own core proxy routing, auth and caching at 1B+ requests a month.
- Build guardrails that block common attacks on LLM APIs and agents.
- Keep observability accurate at massive scale with minimal overhead.
What they offer
- Equity
- Health insurance
- Dental insurance
- Vision insurance
Ideal candidate
Mission-critical backend owner who obsesses over reliability and root causes, sets a high bar for code quality, and thrives owning core systems used by the world's biggest companies.
Requirements
- 5+ years building backend systems in production with ownership of mission-critical systems
- Strong Python with async/high-throughput services (asyncio, FastAPI or similar)
- Track record of improving reliability through refactors, re-architectures and root-cause fixes
- Excellent debugger across services, databases (Postgres, Redis) and distributed systems
- High ownership of customer impact of shipped code
- BS/MS in Computer Science or related field or equivalent exceptional ability
Lab profile
About LiteLLM
Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.
What they build
- AI Gateway
- Unified LLM API
Known for
- World's most popular AI gateway
- Trusted by Adobe, Netflix and NASA
- Secure, reliable LLM access
- Routing, spend control and usage monitoring
Posted · Last seen