Software Engineer, GPU Infrastructure
1 hour agoSalary: 175K - 325KSeattle; California; Canada; New YorkRemoteFull TimeDevopsJobs by Cohere
CohereVisit Cohere website
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
Toronto, Canada
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will deploy and operate GPU Kubernetes clusters across clouds, work with cloud providers and hardware partners, automate fault detection and remediation, improve fleet utilization and troubleshoot production issues. The role includes a compensated 24x7 on-call rotation.
Requirements
- Experience running GPU Kubernetes clusters with thousands of GPUs for ML or HPC
- Experience debugging Linux, networking and performance problems
- Wrote software in Python or Go
- Experience working with researchers or ML engineers
- Track record of finding and fixing bottlenecks
Responsibilities
- Deploy and operate GPU Kubernetes clusters across clouds
- Bring up new hardware generations and providers
- Work with cloud providers and hardware partners on reliability, performance and cost
- Automate node, GPU and fabric fault detection and remediation
- Improve fleet utilization and track cost
- Reduce time to return faulty nodes to service
- Troubleshoot production failures and performance problems
Benefits
- Weekly lunch stipend of $75/£75
- Full health and dental benefits with mental health budget
- RRSP matching, 401K, Pension Scheme
- 100% parental leave top-up for up to 6 months
- Annual enrichment benefits (arts & culture, fitness/wellness, workspace credit)
- Education & learning stipend
- 6 weeks paid vacation
- Travel budget to other offices and annual company offsite
- Co-working benefit
- $500 home office stipend
- Equity
- Compensated 24x7 on-call rotation