Software Engineer - GPU Networking & Distributed Systems

Highlights

• Build the software fabric unifying thousands of GPUs into one cohesive system.
• Unlock next-gen distributed inference with co-optimized communication and compute.
• Enable sub-10-second startup for trillion-parameter models at global scale.

What they offer

• Meaningful equity (U.S. only)
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Flexible PTO including company-wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot (U.S. only)
• Company-facilitated 401(k)

Ideal candidate

You are a systems deep-diver obsessed with performance who loves uniting networking and compute. You thrive going low into hardware and building from scratch when off-the-shelf tools are too slow.

Requirements

• Deep experience with high-performance networking protocols (InfiniBand, RoCE v2) and physics of data movement
• Fluent in C++ or Python with ability to bridge high-level logic and hardware
• Deep understanding of memory hierarchy in modern NVIDIA architectures (H100/Blackwell)
• Willing to dive into TensorRT-LLM source, write custom C++/Python bindings, and debug NVLink topology
• Know when to use off-the-shelf vs build custom when upstream tools are too slow
• Deep knowledge of NCCL, NVSHMEM, and UCX
• Experience with Rust for systems-level or performance-critical networking code