Lead Member of Technical Staff, Inference Infrastructure

Highlights

• Lead technical direction for the AI platform delivering Cohere's LLMs via API.
• Shape next-generation AI platforms powering advanced NLP applications at scale.
• Serve as key customer contact designing customized deployments for their needs.

What they offer

• Weekly $75 lunch stipend and daily lunch program in office
• Full health and dental benefits including mental health budget
• RRSP matching, 401K and Pension Scheme
• 100% parental leave top-up for up to 6 months
• 6 weeks of paid vacation
• $500 home office stipend plus co-working benefit for remote
• Annual enrichment, education and workspace improvement benefits

Ideal candidate

A seasoned infrastructure leader who energizes teams and raises the technical bar. You thrive on ambiguous, evolving challenges, mentor engineers generously, and care deeply about reliable, high-performance AI that solves real business problems.

Requirements

• 8+ years of engineering experience running production infrastructure at large scale with technical leadership
• Experience leading architecture and design of highly available distributed systems with Kubernetes and GPU workloads
• Deep expertise with Kubernetes development, production support and team-wide standards
• Experience across GCP, Azure, AWS, OCI and multi-cloud on-prem/hybrid serving environments
• Ability to design, deploy, support and troubleshoot complex Linux-based environments at scale
• Experience owning compute, storage, network resource and cost management and optimization
• Strong collaboration and communication skills with experience mentoring engineers and leading cross-functional initiatives
• Expertise in computational characteristics of accelerators to drive latency and throughput improvements
• Proficiency in Golang, C++ or other languages for high-performance scalable servers