Member of Technical Staff Training Infrastructure Engineer

Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.

Toronto, Canada
About Cohere

Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.

View jobs by Cohere

Skills

About the Role

You will design scalable software for model training, improve training infrastructure and codebase performance, and build tools that speed training cycles. You will research and test ideas on supercomputing and data infrastructure while helping ship models to production.

Requirements

  • Software engineering
  • Python
  • JAX
  • PyTorch
  • XLA
  • MLIR
  • Distributed training
  • Kubernetes
  • Slurm
  • Ray
  • Large-scale model training
  • Training infrastructure

Responsibilities

  • Design and write high-performance scalable training software.
  • Improve training infrastructure and codebase performance.
  • Build tools that accelerate training cycles and improve training infrastructure.
  • Research, implement, and experiment with supercomputing and data infrastructure.

Benefits

  • Equity
  • Weekly lunch stipend of $75/£75 or equivalent local currency
  • Health and dental benefits
  • Mental health budget
  • RRSP matching, 401K, and Pension Scheme
  • 100% parental leave top-up for up to 6 months
  • Annual enrichment benefits
  • Education and learning stipend
  • 6 weeks of paid vacation
  • Budget for travel to other offices for remote employees
  • Annual company offsite
  • Daily lunch program for office employees
  • Snacks
  • Community and social events
  • Co-working benefit
  • $500 home office stipend
Member of Technical Staff Training Infrastructure Engineer at Cohere | JobStash