Skip to content
← LiteLLM

Staff Backend Engineer

LiteLLM · San Francisco

Infrastructureonsitestaff$250k–$350k
Apply on the lab’s site ↗

At a glance

Highlights

  • Own core proxy routing, auth and caching at 1B+ requests a month.
  • Build guardrails that block common attacks on LLM APIs and agents.
  • Keep observability accurate at massive scale with minimal overhead.

What they offer

  • Equity
  • Health insurance
  • Dental insurance
  • Vision insurance

Ideal candidate

Mission-critical backend owner who obsesses over reliability and root causes, sets a high bar for code quality, and thrives owning core systems used by the world's biggest companies.

Requirements

  • 5+ years building backend systems in production with ownership of mission-critical systems
  • Strong Python with async/high-throughput services (asyncio, FastAPI or similar)
  • Track record of improving reliability through refactors, re-architectures and root-cause fixes
  • Excellent debugger across services, databases (Postgres, Redis) and distributed systems
  • High ownership of customer impact of shipped code
  • BS/MS in Computer Science or related field or equivalent exceptional ability

Lab profile

About LiteLLM

Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.

What they build

  • AI Gateway
  • Unified LLM API

Known for

  • World's most popular AI gateway
  • Trusted by Adobe, Netflix and NASA
  • Secure, reliable LLM access
  • Routing, spend control and usage monitoring
More about LiteLLM →
Apply on the lab’s site ↗

Posted · Last seen