Senior/Staff Software Engineer Back End Inference
55 minutes agoLeadSalary: 205K - 315KCanada; Montreal; New York; Ottawa; San Francisco; Toronto; United StatesRemoteFull TimeBackendJobs by Cohere
CohereVisit Cohere website
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
Toronto, Canada
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
About the Role
You will evolve and scale backend systems for authentication, authorization, deployments, billing, metering, and customer lifecycle management. You will lead architectural initiatives, build reliable control-plane services, design APIs and distributed systems, embed security and privacy controls, and drive projects from threat modeling through production operations.
Requirements
- Backend engineering experience
- Distributed systems, database, networking, operating systems, and security fundamentals
- Experience building production systems in Go, Python, Java, C++, Rust, or similar languages
- Experience designing and operating systems requiring correctness, availability, security, and performance at scale
- Knowledge of concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradation
- Knowledge of authentication, authorization, identity, cryptography, secrets, and tenant isolation
- Experience with APIs, cloud infrastructure, debugging, instrumentation, capacity planning, migrations, incident response, and safe rollouts
Responsibilities
- Evolve and scale backend systems for authentication, authorization, deployment management, billing, metering, and customer lifecycle.
- Lead architectural initiatives across identity, payments, usage systems, and platform scalability.
- Build reliable control-plane services for provisioning, configuring, scaling, and operating model deployments.
- Design APIs and distributed systems with guarantees for correctness, consistency, isolation, recovery, idempotency, and observability.
- Build security and privacy controls, including tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundaries.
- Drive projects from architecture and threat modeling through implementation, rollout, production operations, and iteration.
Benefits
- Weekly lunch stipend of $75/£75 or local-currency equivalent
- Health and dental benefits, including a mental-health budget
- RRSP matching, 401K, and pension scheme
- Parental-leave top-up for up to six months
- Arts, culture, fitness, wellness, quality-time, and workspace-improvement benefits
- Education and learning stipend for conferences, courses, and coaching
- Six weeks of paid vacation
- Remote travel budget for other offices and an annual company offsite
- Co-working benefit
- $500 home-office stipend
- Daily lunch program, snacks, and community and social events for office-based employees
