Senior ML Systems Engineer, Frameworks & Tooling
Cohere · London · San Francisco · New York · Paris · Toronto · Montreal
CHECKED 57M AGO
Frontier labremotesenior$175k–$375k
At a glance
Highlights
- Build and own the training framework powering frontier-scale language models.
- Create tooling that connects research ideas to thousands of GPUs.
- Improve throughput, reliability and monitoring for large-scale training runs.
What they offer
- Weekly $75 lunch stipend
- Full health and dental benefits including mental health budget
- RRSP matching, 401K and pension scheme
- 100% parental leave top-up for up to 6 months
- 6 weeks paid vacation
- $500 home office stipend and co-working benefit
Ideal candidate
Senior systems-minded engineer who loves working across the ML stack to make large-scale training fast and reliable. You care about developer velocity, thoughtful trade-offs, and collaborating with research and infra teams.
Requirements
- Strong engineering experience in large-scale distributed training or HPC systems
- Deep familiarity with JAX internals, distributed training libraries, or custom kernels
- Experience with multi-node cluster orchestration (Slurm, Ray, Kubernetes)
- Comfort debugging performance issues across CUDA/NCCL, networking, IO and data pipelines
- Experience with containerized environments (Docker, Singularity/Apptainer)
- Track record building tools that increase developer velocity for ML teams
- Strong judgment on performance vs complexity and velocity vs maintainability trade-offs
- Strong collaboration skills working with infra, research and deployment teams
- remote policy
- remote-friendly
Lab profile
About Cohere
Security-first enterprise AI company building frontier foundation models for business applications.
What they build
- Command foundation models
- Embed models
- Rerank models
Known for
- Security-first enterprise AI
- Frontier model training and deployment
- Business-focused end-to-end products
Key facts
- Founded in 2019
- Headquartered in Toronto, Canada