Cohere · San Francisco +4 · Remote · Apr 28
Lead technical direction for the AI platform delivering Cohere's LLMs via API.
$235k–$325k
Inference EngineeringInference and Deployment · DEP
Inference Engineering
Serve models fast to millions.
- Optimize low-latency serving
- Own capacity and autoscaling
- Debug production inference issues
100 open43 of 100 list compensation: $100k–$555k
109 open roles
Cohere · Toronto +3 · Remote · Jan 12
Build self-service systems powering Cohere's LLM API platform.
$160k–$260k
Inference EngineeringCohere · San Francisco +3 · Remote · Jan 12
Build next-gen AI platform serving frontier LLMs via easy APIs.
$190k–$325k
Inference EngineeringBaseten · San Francisco +5 · Remote · Aug 29
Build the program framework for Baseten's high-performance inference R&D from zero.
$165k–$330k
Inference EngineeringBaseten · San Francisco +5 · Remote · Jun 23
Own critical parts of the core platform for deploying AI at scale.
$190k–$300k
Inference EngineeringBaseten · San Francisco +4 · Remote · Aug 3
Partner directly with customers to ship high-scale production AI apps end-to-end.
$165k–$330k
Inference EngineeringBaseten · San Francisco +4 · Remote · Apr 23
Own Baseten Voice AI inference stack from roadmap to production.
$165k–$330k
Inference EngineeringBaseten · San Francisco +4 · Remote · Jul 2024
Shape developer experience for deploying mission-critical AI inference.
$165k–$330k
Inference EngineeringBaseten · San Francisco +1 · Remote · Oct 7
Lead team making demanding AI workloads run faster and more efficiently on GPUs.
$240k–$270k
Inference EngineeringBaseten · San Francisco +4 · Remote · Jan 7
Define the roadmap for next-gen AI infrastructure diagnostics and benchmarking.
$165k–$330k
Inference EngineeringBaseten · San Francisco +1 · Remote · Apr 2
Own autoscaling and placement for mission-critical AI inference at scale.
$235k–$335k
Inference EngineeringBaseten · San Francisco +4 · Remote · Oct 5
Make demanding AI workloads run faster across inference engine and runtime.
$180k–$360k
Inference EngineeringBaseten · San Francisco +4 · Remote · Oct 5
Build distributed runtime powering large-scale LLM inference for top AI companies.
$180k–$360k
Inference EngineeringTogether AI · San Francisco · Onsite · Aug 2025
Build the inference backbone for multi-tenant serverless and dedicated endpoints.
$200k–$290k
Inference EngineeringTogether AI · San Francisco · Onsite · Jun 2024
Build production systems powering Together AI inference engine at scale.
$200k–$300k
Inference EngineeringTogether AI · San Francisco · Onsite · Sep 18
Build next-gen efficient serving systems for large foundation models.
$121k–$146k
Inference EngineeringTogether AI · San Francisco · Onsite · Sep 18
Build next-gen efficient serving systems for large foundation models at scale.
$121k–$146k
Inference EngineeringAnyscale · San Francisco +1 · Remote · May 27
Push boundaries of performance for large-scale Batch and Online inference.
$170k–$245k
Inference EngineeringIsomorphic Labs · London · Onsite · Mar 26
Build the largest foundation models in biotech to help cure disease.
Salary not listed
Inference EngineeringPerplexity AI · San Francisco +1 · Onsite · Sep 2
Run one of the highest-throughput inference stacks serving Ask and API traffic.
$170k–$265k
Inference EngineeringPerplexity AI · San Francisco +2 · Onsite · Apr 13
Build and run the inference engine behind every Perplexity query at scale.
$220k–$485k
Inference EngineeringPerplexity AI · London · Onsite · Apr 13
Run the inference engine powering every Perplexity query at scale.
Salary not listed
Inference EngineeringFigure AI · San Jose, CA +1 · Onsite · Jun 26
Own on-board inference architecture for humanoid robots in home and commercial use.
$180k–$275k
Inference EngineeringWaymo · Mountain View, CA, USA +1 · Onsite · Dec 2025
Build scalable, high-throughput, low-latency inference platform for Waymo Driver.
$213k–$263k
Inference EngineeringCartesia · *HQ - San Francisco, CA · Onsite · Dec 2024
Build low-latency, scalable inference stack for cutting-edge foundation models.
$180k–$250k
Inference EngineeringCursor · New York +1 · Onsite · Apr 7
Build the inference platform powering every AI interaction in the product.
Salary not listed
Inference EngineeringMagic · San Francisco · Onsite · Sep 19
Design and scale inference serving for long-context frontier models.
$275k–$550k
Inference EngineeringPika · Palo Alto HQ · Onsite · Jun 23
Accelerate inference for Pika's creative AI video products at scale.
$250k–$350k
Inference EngineeringEtched · San Jose · Onsite · Jun 2025
Building hardware and software for best-in-class inference throughput.
$175k–$275k
Inference EngineeringEtched · San Jose · Onsite · Jan 18
Build and own high-leverage, relationship-driven recruiting for inference teams.
$100k–$230k
Inference Engineering