We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

Software Engineer AI Inference

European sovereign cloud and AI provider offering GPU compute, AI model APIs, cloud infrastructure, bare metal, managed data, containers, and quantum services.

34 current maintainers32 active leads8 new active leads11 lead step-downs
Paris, France
About Scaleway

Scaleway SAS is a Paris-based subsidiary of iliad Group that operates a European cloud and AI platform. Its current offering includes GPU clusters and instances, serverless generative-model APIs, compute, storage, networking, managed databases, Kubernetes, serverless services, and Quantum as a Service.

View jobs by Scaleway

Skills

Candidate Availability

About the Role

You will build and operate infrastructure for serving LLMs and other generative models at scale. You will design, deploy and maintain Kubernetes-based services, develop backend services in Golang, optimize serving stacks with vLLM, Triton and CUDA, integrate open-source AI tooling, troubleshoot complex issues, join architecture discussions, and contribute to code reviews.

Requirements

  • Senior / Tech Lead profile with extensive experience in software engineering and complex systems architecture
  • Strong experience with Golang in production
  • Proficiency with Kubernetes and container orchestration
  • Knowledge of AI models (LLMs, diffusion models)
  • Solid understanding of backend architectures and DevOps practices
  • Hands-on experience deploying and scaling ML models is appreciated

Responsibilities

  • Build and operate infrastructure for serving LLMs and other generative models at scale
  • Design, deploy and maintain Kubernetes-based services optimized for AI inference
  • Develop robust backend services in Golang
  • Optimize serving stacks using tools like vLLM, Triton and CUDA
  • Integrate open-source AI tooling such as Hugging Face and KServe
  • Participate in architecture discussions and make technical decisions
  • Troubleshoot and resolve complex infrastructure and deployment issues
  • Collaborate with internal teams to integrate new AI features
  • Contribute to code reviews and knowledge sharing

Benefits

  • Hybrid work: up to 3 days remote per week
  • Modern offices with terraces and bike facilities
  • Chef-prepared meals at HQ; Swile card for regional sites
  • Support for gym memberships, childcare and caregiver services

Hiring Process

Discovery call with a recruiter (30 min); technical interview (1h); hiring manager interview (45 min); head of tribe interview (45 min).