Senior Software Engineer Agent Infrastructure
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build and productionize infrastructure for agentic AI systems. You will develop secure execution, identity, authentication, model routing, resource management, and agent state capabilities. You will prototype technologies, evaluate their production readiness, and work with research teams to shape future platform requirements.
Requirements
- Experience building production ML infrastructure with strong systems fundamentals
- Experience with agentic systems, multi-agent workflows, or agent development frameworks
- Familiarity with model routing and LLM provider frameworks
- Experience with scalable, fault-tolerant distributed systems and Kubernetes
- Ability to prototype quickly and make productionization decisions
Responsibilities
- Build secure execution environments for agent-generated code
- Develop identity, authentication, and trust boundaries for agents
- Build model routing and orchestration capabilities
- Manage rate limiting, quotas, and resources for agent workflows
- Develop state management, memory, and filesystem abstractions
- Turn emerging ML research ideas into production-ready infrastructure
- Prototype and evaluate new technologies for production use
- Partner with research teams to shape infrastructure requirements
Benefits
- Weekly lunch stipend of $75/£75 or local equivalent
- Health and dental benefits, including a mental-health budget
- RRSP matching, 401K, and Pension Scheme
- Parental leave top-up for up to 6 months
- Annual enrichment benefits and workspace improvement credit
- Education and learning stipend
- 6 weeks of paid vacation
- Remote-office travel budget and annual company offsite
- Co-working benefit
- $500 home-office stipend