Member of Technical Staff, North Modelling (Evals)

Highlights

• Own the eval strategy for North's enterprise AI workspace and agent workflows.
• Turn real user feedback and production failures into continuous high-quality evals.
• Translate eval insights into model improvements with central modelling teams.

What they offer

• Weekly $75 lunch stipend and daily lunch program in office
• Full health and dental benefits including mental health budget
• RRSP / 401K / Pension matching and 6 months parental leave top-up
• 6 weeks paid vacation, annual offsite and office travel budget
• $500 home office stipend and co-working benefit

Ideal candidate

Applied ML engineer who obsesses over measurement and real-world product quality, translating messy user signals into rigorous evals that drive better enterprise AI workflows.

Requirements

• Improved LLM-powered, agent-powered, or AI-product systems through evals, feedback loops, data curation, prompting, model adaptation, or model selection
• Deep care for evaluation craft: representative tasks, precise rubrics, clean data, failure analysis, and regression tracking
• Strong applied MLE judgment reasoning about model behavior, eval validity, and production tradeoffs
• Comfortable working close to users and product teams translating qualitative signals into measurement
• Self-directed and motivated by open-ended problems requiring technical depth and product understanding