Skip to content
← Cohere

Senior Software Engineer, GPU Infrastructure (HPC)

Cohere · Canada · United States

CHECKED 1H AGO

Frontier labremotesenior$200k–$238k
Apply on the lab’s site ↗

At a glance

Highlights

  • Build and operate superclusters that train and serve frontier enterprise AI models.
  • Partner directly with researchers to accelerate industry-leading AI development.
  • Create intuitive self-service tooling that helps researchers optimize training.

What they offer

  • Offers Equity
  • Weekly lunch stipend and daily lunch program in office
  • Full health and dental benefits including mental health budget
  • RRSP matching, 401K and Pension Scheme
  • 100% parental leave top-up for up to 6 months
  • 6 weeks paid vacation
  • Annual enrichment, education and workspace improvement benefits
  • $500 home office stipend and co-working benefit
  • Compensated 24x7 on-call rotation
  • Annual company offsite and travel budget to other offices

Ideal candidate

A self-directed infrastructure builder who thrives partnering with researchers, obsesses over stability and scalability, and enjoys turning complex operational challenges into intuitive, automated systems.

Requirements

  • Deep expertise in ML/HPC infrastructure with GPU/TPU clusters and distributed training
  • Experience deploying, managing and troubleshooting cloud-native Kubernetes clusters at scale
  • Proficiency in Python for ML tooling and Go for systems engineering
  • Familiarity with Linux internals, RDMA networking and performance optimization
  • Track record collaborating closely with AI researchers or ML engineers
  • Ability to identify bottlenecks and drive impact in a fast-paced environment, including 24x7 on-call
remote policy
remote-friendly

Lab profile

About Cohere

Security-first enterprise AI company building frontier foundation models for business applications.

What they build

  • Command foundation models
  • Embed models
  • Rerank models

Known for

  • Security-first enterprise AI
  • Frontier model training and deployment
  • Business-focused end-to-end products

Key facts

  • Founded in 2019
  • Headquartered in Toronto, Canada
More about Cohere →
Apply on the lab’s site ↗