Lead Member of Technical Staff Inference Infrastructure

Skills

About the Role

You will set technical direction for production model-serving infrastructure. You will lead the architecture and strategy for optimized NLP-model deployments, guide multi-cloud infrastructure decisions, design customer deployments, mentor engineers, establish engineering standards, and conduct senior technical reviews.

Requirements

• 8+ years of engineering experience operating large-scale production infrastructure
• Architecture and design experience with highly available distributed systems, Kubernetes, and GPU workloads
• Kubernetes development, production coding, and support
• GCP, Azure, AWS, OCI, and multi-cloud or hybrid-serving environments
• Linux computing environments
• Compute, storage, network resource, and cost management
• GPU, TPU, or custom accelerator expertise
• Distributed systems
• Golang or C++
• Technical leadership
• Communication

Responsibilities

• Lead architecture and strategy for optimized NLP-model production deployments
• Guide multi-cloud infrastructure decisions
• Design customized customer deployments
• Mentor engineers and lead cross-functional initiatives
• Set coding standards and conduct senior technical reviews

Benefits

• Weekly lunch stipend of $75/£75 or local equivalent
• Health and dental benefits, including a mental-health budget
• RRSP matching, 401K, and pension scheme
• Parental leave top-up for up to 6 months
• Arts, culture, fitness, wellness, quality-time, and workspace-improvement benefits
• Education and learning stipend
• 6 weeks of paid vacation
• Travel budget for other offices and an annual company offsite
• Co-working benefit
• $500 home-office stipend