Skip to content
← LiteLLM

Senior Backend Engineer

LiteLLM · San Francisco

Infrastructureonsitesenior$200k–$260k
Apply on the lab’s site ↗

At a glance

Highlights

  • Own core gateway routing, auth and caching at 1B+ requests a month.
  • Build in-gateway guardrails that block attacks on LLM APIs and agents.
  • Your code runs in the critical path for Adobe, Netflix, NASA and NVIDIA.

What they offer

  • Equity
  • Health insurance
  • Dental insurance
  • Vision insurance

Ideal candidate

High-ownership backend engineer who loves owning mission-critical systems and fixing root causes for good. A relentless debugger who raises the bar on reliability and code quality.

Requirements

  • 2+ years building backend systems in production with ownership of mission-critical systems
  • Strong Python with async or high-throughput services (asyncio, FastAPI or similar)
  • Track record of improving production reliability through refactors and root-cause fixes
  • Excellent debugging across services, databases (Postgres, Redis) and distributed systems
  • High ownership of customer impact of shipped code
  • BS/MS in Computer Science or related field or equivalent exceptional ability

Lab profile

About LiteLLM

Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.

What they build

  • AI Gateway
  • Unified LLM API

Known for

  • World's most popular AI gateway
  • Trusted by Adobe, Netflix and NASA
  • Secure, reliable LLM access
  • Routing, spend control and usage monitoring
More about LiteLLM →
Apply on the lab’s site ↗

Posted · Last seen