Software Engineer, ML Ops
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will run secure developer environments, own container image build and CI/CD tooling, instrument training code, build self-service debugging tools for researchers, set infrastructure best practices, and troubleshoot production issues. The role includes a compensated 24x7 on-call rotation.
Requirements
- Experience running a developer platform in production
- Experience making ML engineers or researchers faster
- Linux and Kubernetes skills to debug production systems
- Wrote software in Python or Go
- Experience working with researchers or ML engineers
- Track record of finding and fixing bottlenecks
Responsibilities
- Run secure developer environments
- Own container image build and CI/CD tooling
- Instrument training code and build self-service tooling
- Set infrastructure best practices through AI enablement, documentation and office hours
- Troubleshoot production failures and performance problems
- Build automation, infrastructure-as-code and observability
Benefits
- Weekly lunch stipend of $75/£75
- Full health and dental benefits with mental health budget
- RRSP matching, 401K, Pension Scheme
- 100% parental leave top-up for up to 6 months
- Annual enrichment benefits (arts & culture, fitness/wellness, workspace credit)
- Education & learning stipend
- 6 weeks paid vacation
- Travel budget to other offices and annual company offsite
- Co-working benefit
- $500 home office stipend
- Compensated 24x7 on-call rotation