Senior Backend Engineer
LiteLLM · San Francisco
Infrastructureonsitesenior$200k–$260k
At a glance
Highlights
- Own core gateway routing, auth and caching at 1B+ requests a month.
- Build in-gateway guardrails that block attacks on LLM APIs and agents.
- Your code runs in the critical path for Adobe, Netflix, NASA and NVIDIA.
What they offer
- Equity
- Health insurance
- Dental insurance
- Vision insurance
Ideal candidate
High-ownership backend engineer who loves owning mission-critical systems and fixing root causes for good. A relentless debugger who raises the bar on reliability and code quality.
Requirements
- 2+ years building backend systems in production with ownership of mission-critical systems
- Strong Python with async or high-throughput services (asyncio, FastAPI or similar)
- Track record of improving production reliability through refactors and root-cause fixes
- Excellent debugging across services, databases (Postgres, Redis) and distributed systems
- High ownership of customer impact of shipped code
- BS/MS in Computer Science or related field or equivalent exceptional ability
Lab profile
About LiteLLM
Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.
What they build
- AI Gateway
- Unified LLM API
Known for
- World's most popular AI gateway
- Trusted by Adobe, Netflix and NASA
- Secure, reliable LLM access
- Routing, spend control and usage monitoring
Posted · Last seen