Skip to content
← Cohere

Senior ML Systems Engineer, Frameworks & Tooling

Cohere · London · San Francisco · New York · Paris · Toronto · Montreal

CHECKED 57M AGO

Frontier labremotesenior$175k–$375k
Apply on the lab’s site ↗

At a glance

Highlights

  • Build and own the training framework powering frontier-scale language models.
  • Create tooling that connects research ideas to thousands of GPUs.
  • Improve throughput, reliability and monitoring for large-scale training runs.

What they offer

  • Weekly $75 lunch stipend
  • Full health and dental benefits including mental health budget
  • RRSP matching, 401K and pension scheme
  • 100% parental leave top-up for up to 6 months
  • 6 weeks paid vacation
  • $500 home office stipend and co-working benefit

Ideal candidate

Senior systems-minded engineer who loves working across the ML stack to make large-scale training fast and reliable. You care about developer velocity, thoughtful trade-offs, and collaborating with research and infra teams.

Requirements

  • Strong engineering experience in large-scale distributed training or HPC systems
  • Deep familiarity with JAX internals, distributed training libraries, or custom kernels
  • Experience with multi-node cluster orchestration (Slurm, Ray, Kubernetes)
  • Comfort debugging performance issues across CUDA/NCCL, networking, IO and data pipelines
  • Experience with containerized environments (Docker, Singularity/Apptainer)
  • Track record building tools that increase developer velocity for ML teams
  • Strong judgment on performance vs complexity and velocity vs maintainability trade-offs
  • Strong collaboration skills working with infra, research and deployment teams
remote policy
remote-friendly

Lab profile

About Cohere

Security-first enterprise AI company building frontier foundation models for business applications.

What they build

  • Command foundation models
  • Embed models
  • Rerank models

Known for

  • Security-first enterprise AI
  • Frontier model training and deployment
  • Business-focused end-to-end products

Key facts

  • Founded in 2019
  • Headquartered in Toronto, Canada
More about Cohere →
Apply on the lab’s site ↗