Skip to content
← LiteLLM

ML Engineer

LiteLLM · San Francisco

Infrastructureonsitejunior$200k–$250k
Apply on the lab’s site ↗

At a glance

Highlights

  • Unify OpenAI and Anthropic API formats across 100+ LLM providers.
  • Design gateway support for skills, compaction, and batch features.
  • Build interoperability layer spanning LLMs, MCPs, and agents.

What they offer

  • Competitive salary
  • Equity
  • Health, dental, and vision benefits

Ideal candidate

Early-career backend builder who thrives in small, fast teams, loves open source and talking to users, and wants to own meaningful AI infrastructure used by thousands.

Requirements

  • 1-2 years of backend/full-stack experience with production systems
  • Passion for open source and user engagement
  • Experience working with the OpenAI API, including nuances of /chat/completions vs /responses
  • Strong work ethic and ability to thrive in small teams
  • Eagerness to talk to users and help solve real problems

Lab profile

About LiteLLM

Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.

What they build

  • AI Gateway
  • Unified LLM API

Known for

  • World's most popular AI gateway
  • Trusted by Adobe, Netflix and NASA
  • Secure, reliable LLM access
  • Routing, spend control and usage monitoring
More about LiteLLM →
Apply on the lab’s site ↗

Posted · Last seen