ML Infrastructure Engineer - New Grad
SambaNova · Austin, Texas, United States; San Jose, California, United States · Austin, TX · San Jose, CA
Infrastructureonsitenew grad$131k–$197k
At a glance
Highlights
- Serve state-of-the-art models on custom RDU accelerators for agentic workloads.
- Bring decoding, caching, and tool-calling features into production inference.
- Own accuracy and regression testing that guards production releases.
What they offer
- Equity
- 95% employee medical premium coverage, 77% for dependents
- Dental, vision and life insurance plus disability coverage
- HSA with employer contribution and FSA options
- Headspace, Gympass+, One Medical and EAP well-being benefits
Ideal candidate
Recent CS/EE graduate who loves systems work and is excited to ship production inference features, debug performance issues, and learn quickly in an accelerator-focused team.
Requirements
- B.S. in Computer Science, Electrical Engineering, or related field
- Strong programming skills in Python
- Understanding of algorithms, data structures, concurrency, and systems design
- Coursework or project experience in distributed systems or machine learning
- Experience with LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM
- Experience with inference techniques such as speculative decoding, KV caching, or continuous batching
- Experience with PyTorch
Lab profile
About SambaNova
Full-stack AI infrastructure with RDU dataflow chips for fast agentic inference.
What they build
- RDU Reconfigurable Dataflow Unit
- SambaRack rack-scale hardware
- Full-stack AI inference platform
Known for
- Reconfigurable dataflow architecture alternative to GPUs
- High decode performance for agentic workloads
- Full-stack hardware-software co-design
Key facts
- Founded in 2017
- Headquartered in Palo Alto, California
Posted · Last seen