Inference Software Engineer
Etched · San Jose
CHECKED 8H AGO
Infrastructureonsite$175k–$275k
At a glance
Highlights
- Building hardware and software for best-in-class inference throughput.
- Port state-of-the-art models to novel chip architecture.
- Scale multi-node inference runtime with robust error handling.
What they offer
- Medical, dental, and vision packages with generous premium coverage
- $500 per month credit for waiving medical benefits
- Housing subsidy of $2.5k per month for those living within walking distance of the office
- Relocation support for those moving to San Jose (Santana Row)
- Various wellness benefits covering fitness, mental health, and more
- Daily lunch + dinner in our office
- Unlimited compute budget subject to ROI justification
Ideal candidate
Systems engineer who thrives on performance-critical distributed systems and loves bringing cutting-edge models to novel hardware. Hands-on builder eager to work in-person across hardware and software boundaries.
Requirements
- Proficiency in C++ or Rust
- Understanding of performance-sensitive or complex distributed software systems like Linux internals, accelerator architectures, compilers, or high-speed interconnects
- Familiarity with PyTorch or JAX
- Experience porting applications to non-standard accelerator hardware or hardware platforms
- remote policy
- Fully in-person
Lab profile
About Etched
Building specialized AI chips and systems for frontier inference with best-in-class throughput and latency.
What they build
- Sohu AI inference chip
- AI racks and hardware systems
- Inference software stack
Known for
- Full-stack co-design of chips, racks, software and manufacturing
- Best-in-class throughput and latency for prefill and decode
- Inference-optimized architecture
Key facts
- Backed by hundreds of millions from top-tier investors