Sr. Software Engineer, Training/Inference (C++)

Highlights

• Build the high-performance inference platform serving Grok to millions daily.
• Own large-scale serving systems end-to-end for speed and reliability at scale.
• Help shape next-gen systems for test-time compute and model-hardware co-design.

What they offer

• equity
• comprehensive medical, vision, and dental coverage
• 401(k) retirement plan
• short and long-term disability insurance
• life insurance
• various other discounts and perks

Ideal candidate

Systems-minded engineer with deep low-level experience who thrives on optimization and owns large-scale production systems end-to-end to make AI fast and reliable for millions.

Requirements

• Bachelor's degree in computer science, computer engineering, or science discipline
• 5+ years of low-level systems programming experience in C/C++ or Rust
• Experience with large-scale, high-concurrency production serving systems
• Experience with GPU inference engines such as vLLM, SGLang, Triton or TensorRT-LLM
• Strong background in batching, caching, load balancing and parallelism optimizations
• Experience with GPU kernels, code generation and quantization or speculative decoding
• Experience testing, benchmarking and ensuring reliability of inference services
• Experience designing CI/CD infrastructure for inference deployments