Software Engineer AI Inference
European sovereign cloud and AI provider offering GPU compute, AI model APIs, cloud infrastructure, bare metal, managed data, containers, and quantum services.
About Scaleway
Scaleway SAS is a Paris-based subsidiary of iliad Group that operates a European cloud and AI platform. Its current offering includes GPU clusters and instances, serverless generative-model APIs, compute, storage, networking, managed databases, Kubernetes, serverless services, and Quantum as a Service.
Skills
Candidate Availability
About the Role
You will build and operate infrastructure for serving LLMs and other generative models at scale. You will design, deploy and maintain Kubernetes-based services, develop backend services in Golang, optimize serving stacks with vLLM, Triton and CUDA, integrate open-source AI tooling, troubleshoot complex issues, join architecture discussions, and contribute to code reviews.
Requirements
- Senior / Tech Lead profile with extensive experience in software engineering and complex systems architecture
- Strong experience with Golang in production
- Proficiency with Kubernetes and container orchestration
- Knowledge of AI models (LLMs, diffusion models)
- Solid understanding of backend architectures and DevOps practices
- Hands-on experience deploying and scaling ML models is appreciated
Responsibilities
- Build and operate infrastructure for serving LLMs and other generative models at scale
- Design, deploy and maintain Kubernetes-based services optimized for AI inference
- Develop robust backend services in Golang
- Optimize serving stacks using tools like vLLM, Triton and CUDA
- Integrate open-source AI tooling such as Hugging Face and KServe
- Participate in architecture discussions and make technical decisions
- Troubleshoot and resolve complex infrastructure and deployment issues
- Collaborate with internal teams to integrate new AI features
- Contribute to code reviews and knowledge sharing
Benefits
- Hybrid work: up to 3 days remote per week
- Modern offices with terraces and bike facilities
- Chef-prepared meals at HQ; Swile card for regional sites
- Support for gym memberships, childcare and caregiver services
Hiring Process
Discovery call with a recruiter (30 min); technical interview (1h); hiring manager interview (45 min); head of tribe interview (45 min).
