Software Engineer Product Infrastructure and Platform Reliability
Tokyo-based frontier AI R&D company that develops nature-inspired AI research and commercial AI products for enterprises and users.
Funding history
About Sakana AI K.K.
Sakana AI develops frontier AI research inspired by collective intelligence and self-evolution, alongside AI products and applied solutions for enterprises and Japan’s public sector.
Skills
About the Role
You will own the reliability and SLA management of production LLM products and their inference platform. You will operate cloud and GPU infrastructure, improve latency, throughput, utilization, and cost efficiency, and support deployment and rollback. You will build observability and incident-response practices, participate in on-call work, plan capacity, and translate enterprise requirements into infrastructure design.
Requirements
- Experience designing and operating production cloud infrastructure, such as AWS or GCP
- Experience operating containerized services, APIs, batch jobs, or model inference workloads in production
- Experience managing and automating infrastructure with IaC or comparable tooling
- Experience with monitoring, alerting, incident response, and postmortems
- Ability to assess GPU, cloud, and serving resources for cost, performance, and availability
- Experience with vLLM, TensorRT-LLM, or SGLang
- English communication skills for technical projects and stakeholder discussions
Responsibilities
- Manage reliability and SLAs across products
- Operate and improve production LLM inference infrastructure
- Improve latency, throughput, GPU utilization, and cost efficiency
- Operate LLM serving systems and support deployment and rollback workflows
- Build monitoring, alerting, incident response, postmortems, and prevention practices
- Participate in the on-call rotation
- Translate enterprise security, availability, compliance, and SLA needs into infrastructure design
- Support capacity planning and cost management
Hiring Process
Find a role; email careers@sakana.ai with a brief introduction and the role; submit the Google Form with a CV and English cover letter.