Senior Technical Program Manager Machine Learning Infrastructure
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will manage machine-learning infrastructure programs covering inference, efficiency, serving, and endpoints. You will coordinate delivery, improve processes, manage incidents and priorities, track scope and budgets, and communicate progress across technical and non-technical stakeholders.
Requirements
- 5+ years of technical program management experience in machine learning infrastructure
- Knowledge of ML infrastructure design and implementation
- Knowledge of engineering best practices
- Experience with model inference, serving, efficiency, and endpoints
- Experience in fast-paced, low-structure environments
- Technical hands-on experience preferred
- Experience with ML teams preferred
Responsibilities
- Manage the infrastructure program portfolio
- Coordinate cross-functional program execution
- Establish processes that support development and engineering practices
- Drive incident improvement and root-cause remediation
- Prioritize overlapping projects and programs
- Track timelines, deliverables, budgets, and scope
- Communicate program progress, plans, and incidents
- Partner with senior program leads
Benefits
- Weekly lunch stipend of $75/£75 or local equivalent
- Health and dental benefits
- Mental health budget
- RRSP matching, 401K, and pension scheme
- Parental leave top-up for up to 6 months
- Arts and culture, fitness and wellness, quality-time, and workspace-improvement credits
- Education and learning stipend
- 6 weeks of paid vacation
- Travel budget for other offices and annual company offsite
- Co-working benefit
- $500 home office stipend
- Daily lunch program for office workers
- Snacks and community and social events for office workers