Skip to content
← Baseten

Software Engineer - Inference Product

Baseten · San Francisco · New York

Infrastructureremotemid-level$200k–$400k
Apply on the lab’s site ↗

At a glance

Highlights

  • Own the API layer behind Model APIs serving latest open-source models.
  • Build metering and billing for every request with real-time accuracy.
  • Ship routing and capacity systems across a global GPU fleet.

What they offer

  • Meaningful equity (U.S. only)
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company-wide Winter Break
  • Paid parental leave
  • Fertility and family-building stipend through Carrot (U.S. only)
  • Company-facilitated 401(k)

Ideal candidate

Product-minded backend engineer who thrives owning high-scale production systems and cares deeply about developer experience. Motivated to shape how AI inference is priced, packaged, and delivered at scale.

Requirements

  • Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or related field, or equivalent practical experience
  • 3+ years building and operating distributed systems, backend infrastructure, or large-scale APIs
  • Proven track record owning low-latency, reliable backend services including rate limiting, auth, quotas and metering
  • Strong performance instincts: profiling, tracing, capacity planning, and SLO management
  • Comfort debugging performance and reliability across multiple layers of the stack
  • Strong sense of developer experience and how systems are used
  • Eagerness to learn new languages, frameworks, and inference engineering
  • Excellent written communication and collaboration skills

Lab profile

About Baseten

Powers mission-critical AI inference to bring cutting-edge models into production.

What they build

  • Mission-critical inference platform
  • Flexible infrastructure for production models
  • Developer tooling for AI deployment

Known for

  • Applied AI research
  • Flexible infrastructure
  • Seamless developer tooling

Key facts

  • Raised Series F
More about Baseten →
Apply on the lab’s site ↗

Posted · Last seen