ML Engineer
LiteLLM · San Francisco
Infrastructureonsitejunior$200k–$250k
At a glance
Highlights
- Unify OpenAI and Anthropic API formats across 100+ LLM providers.
- Design gateway support for skills, compaction, and batch features.
- Build interoperability layer spanning LLMs, MCPs, and agents.
What they offer
- Competitive salary
- Equity
- Health, dental, and vision benefits
Ideal candidate
Early-career backend builder who thrives in small, fast teams, loves open source and talking to users, and wants to own meaningful AI infrastructure used by thousands.
Requirements
- 1-2 years of backend/full-stack experience with production systems
- Passion for open source and user engagement
- Experience working with the OpenAI API, including nuances of /chat/completions vs /responses
- Strong work ethic and ability to thrive in small teams
- Eagerness to talk to users and help solve real problems
Lab profile
About LiteLLM
Open-source AI gateway providing unified, secure access to LLMs for production routing and governance.
What they build
- AI Gateway
- Unified LLM API
Known for
- World's most popular AI gateway
- Trusted by Adobe, Netflix and NASA
- Secure, reliable LLM access
- Routing, spend control and usage monitoring
Posted · Last seen