Machine Learning Engineer - Inference
Together AI · San Francisco
CHECKED 3H AGO
Infrastructureonsite$200k–$300k
At a glance
Highlights
- Build production systems powering Together AI inference engine at scale.
- Optimize runtime inference services for large-scale AI applications.
- Collaborate with researchers to bring new AI capabilities to the world.
What they offer
- Startup equity
- Health insurance
- Competitive benefits
Ideal candidate
Performance-obsessed engineer who loves building reliable systems at scale and collaborating with researchers to turn cutting-edge AI into real-world products.
Requirements
- 3+ years writing high-performance, well-tested, production-quality code
- Proficiency with Python and PyTorch
- Experience building high-performance libraries and tooling
- Strong understanding of low-level OS concepts like threading, memory, networking and scale
- Knowledge of AI inference systems such as TGI, vLLM, TensorRT-LLM preferred
- Knowledge of inference techniques like speculative decoding and CUDA/Triton preferred
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs