Software Engineer Data Infrastructure
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, build, and operate a distributed storage system for model training and evaluation. You will run stateful systems across Kubernetes clusters at petabyte scale, collaborate with researchers and training-infrastructure teams, and solve networking, I/O, consistency, throughput, latency, and durability challenges across regions and backends.
Requirements
- Storage systems
- Replication
- Consistency
- Caching
- Data lifecycle management
- Python
- Go
- Kubernetes
- Persistent Volumes
- CSI drivers
- StatefulSets
- S3
- POSIX filesystems
Responsibilities
- Design, build, and operate distributed storage systems for model training and evaluation
- Run the system across Kubernetes clusters at petabyte scale
- Translate training workload behavior into throughput, latency, and durability requirements
- Solve networking, I/O, and consistency challenges for datasets and checkpoints across regions and backends
Benefits
- Weekly lunch stipend of $75/£75 or local equivalent
- Health and dental benefits
- Mental health budget
- RRSP matching, 401K, and Pension Scheme
- 100% parental-leave top-up for up to 6 months
- Arts and culture, fitness/wellness, quality-time, and workspace-improvement benefits
- Education and learning stipend
- 6 weeks of paid vacation
- Remote-office travel budget and annual company offsite
- Co-working benefit
- $500 home-office stipend