We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

Staff Software Engineer, Data Infrastructure

Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.

Toronto, Canada
About Cohere

Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.

View jobs by Cohere

Skills

Candidate Availability

About the Role

You will architect and lead the design of a unified distributed storage layer that feeds model training and evaluation at petabyte scale, keeping thousands of GPUs busy. You will own its deployment across multiple Kubernetes clusters, work with researchers and training-infra teams to define data read/write patterns, and tackle networking, I/O and consistency challenges of moving large datasets and checkpoints across regions and backends.

Requirements

  • Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management, with architecture and design experience
  • Strong coding ability in Python and Go, with ability to lead implementations and mentor others
  • Proven experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets
  • Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems

Responsibilities

  • Design, architect, and operate the distributed storage system that feeds model training and evaluation
  • Lead and own the deployment of the system across multiple Kubernetes clusters at petabyte scale
  • Set standards and best practices for the organization
  • Collaborate with researchers and training-infra teams to define how jobs read and write data
  • Translate data patterns into throughput, latency, and durability requirements that shape the platform roadmap
  • Solve networking, I/O, and consistency challenges of moving large datasets and checkpoints across regions and backends

Benefits

  • Weekly lunch stipend of $75/£75 or local equivalent
  • Full health and dental benefits, including a separate mental health budget
  • RRSP matching, 401K, Pension Scheme
  • 100% Parental Leave top-up for up to 6 months for either parent
  • Annual enrichment benefits: arts & culture, fitness/wellness, quality time, workspace improvement credit
  • Education & learning stipend for conferences, courses, and coaching
  • 6 weeks of paid vacation (30 working days)
  • Budget for traveling to other offices if remote, plus annual company offsite
  • Co-working benefit for those not near an office
  • Daily lunch program, snacks, and community and social events in the office
  • $500 home office stipend
  • Equity