Member of Technical Staff, LLM Infrastructure

Highlights

• Design core systems powering Fireworks' generative AI platform at scale.
• Bridge customers to ultra-performant proprietary inference engine.
• Tackle low-latency inference and scalable model serving challenges.

What they offer

• Equity

Ideal candidate

Infrastructure-minded engineer with 3+ years building ML systems who cares about reliability, performance, and model quality. Collaborative builder excited to solve hard inference challenges with world-class researchers.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related technical field or equivalent experience
• 3+ years in software engineering with focus on infrastructure or machine learning systems
• Strong programming skills in Python, Go, or similar language
• Proven experience in ML infrastructure and tooling
• Basic understanding of LLM concepts including context length, disaggregated prefill and KV cache
• 5+ years experience in infrastructure or ML systems preferred
• Experience with open-source inference engines like vLLM, SGLang or TRT-LLM preferred