Mistral AI · New York +1 · Onsite · Sep 24
Own end-to-end demand forecast linking pipeline to GPU fleet capacity.
Salary not listed
Inference EngineeringInference and Deployment · DEP
Inference Engineering
Serve models fast to millions.
- Optimize low-latency serving
- Own capacity and autoscaling
- Debug production inference issues
100 open43 of 100 list compensation: $100k–$555k
109 open roles
H Company · Hybrid London · Remote · Apr 10
Build and operate systems serving H's foundational models in production.
Salary not listed
Inference EngineeringH Company · Hybrid Paris · Remote · Apr 14
Build and operate systems serving multimodal models for Computer Use Agents.
Salary not listed
Inference EngineeringNuro · Mountain View, California (HQ) +1 · Onsite · Aug 11
Build core ML infrastructure powering Nuro's universal autonomy platform.
$194k–$352k
Inference EngineeringNuro · Mountain View, California (HQ) +1 · Onsite · Aug 11
Build pipelines to train, validate and deploy autonomy models for self-driving fleet.
$160k–$241k
Inference EngineeringSambaNova · San Jose, California, United States +1 · Onsite · Jun 3
Lead inference serving platform for foundation models on RDU hardware.
$245k–$325k
Inference EngineeringThinking Machines Lab · San Francisco · Onsite · Oct 10
Build and scale distributed inference serving Inkling and Tinker in production.
$350k–$500k
Inference EngineeringThinking Machines Lab · San Francisco +1 · Onsite · Oct 2
Own reliability and scale of production systems serving frontier models live.
$300k–$400k
Inference EngineeringxAI · Palo Alto, CA; Seattle, WA +1 · Onsite · Oct 2024
Build the high-performance platform serving Grok to millions daily.
$180k–$440k
Inference EngineeringxAI · Palo Alto, CA · Onsite · Jul 6
Design and optimize the inference stack for RL workloads at all scales.
$180k–$440k
Inference EngineeringDatabricks Mosaic · San Francisco, California · Onsite · Oct 2025
Lead architecture of inference engine powering Foundation Model API.
$191k–$233k
Inference EngineeringDatabricks Mosaic · San Francisco, California +1 · Onsite · Jul 24
Build LLM infrastructure powering large-scale enterprise inference workloads.
$190k–$265k
Inference EngineeringModal Labs · San Francisco · Onsite · Sep 16
Own direction of LLM inference platform serving frontier open-source models at scale.
$300k–$350k
Inference EngineeringModal Labs · New York +1 · Onsite · Jul 5
Own end-to-end inference research bets from idea to production impact.
$150k–$350k
Inference EngineeringModal Labs · San Francisco · Remote · Oct 5
Make demanding ML workloads start quickly and run efficiently at scale.
$220k–$300k
Inference EngineeringRhoda AI · Mountain View · Onsite · May 12
Own inference performance end-to-end for foundation models in production.
$175k–$250k
Inference EngineeringPrime Intellect · Remote +1 · Remote · Jul 8
Build multi-tenant LLM serving across cloud GPU fleets at scale.
$150k–$300k
Inference EngineeringRoboflow · NY, SF or Remote · Remote · Jul 1
Steward flagship open-source inference engine used by tens of thousands.
Salary not listed
Inference EngineeringLiquid AI · Boston · Remote · Aug 26
Build benchmarks for inference performance and model quality across hardware.
Salary not listed
Inference Engineering