Senior HPC Systems Engineer
Nscale is a London-based, full-stack AI cloud and infrastructure company that provides GPU compute, managed AI services, orchestration software, data centers, and power infrastructure for AI training, fine-tuning, and inference.
Funding history
About Nscale
Nscale builds and operates vertically integrated AI infrastructure spanning software, GPU compute, networking, storage, purpose-built data centers, and power. Its active cloud platform offers self-service inference endpoints, fine-tuning, managed Kubernetes and Slurm, virtual machines, and GPU clusters.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will act as a senior escalation point for infrastructure incidents, diagnose GPU, network, and storage faults, and deliver safe changes in live customer environments. You will improve monitoring, runbooks, and automation; communicate incident impact clearly; mentor engineers; participate in on-call support; and travel to sites when required.
Requirements
- 6+ years of infrastructure, operations, or support engineering experience
- 2–3+ years of hands-on GPU, HPC, or large-scale data center experience
- NVIDIA GPU platforms, drivers, firmware, nvidia-smi, DCGM, and XID analysis
- InfiniBand or RoCE RDMA fabrics
- Slurm, Pyxis/Enroot, MPI, and multi-GPU job troubleshooting
- Linux systems engineering
- BMC, Redfish, and bare-metal provisioning
- L2/L3 networking, routing, BGP, VLANs, VXLAN, firewalls, and load balancing
- Prometheus or Grafana
- Bash or Python scripting
- Git and infrastructure automation tools such as Ansible or Terraform
- Data center operations
Responsibilities
- Serve as a senior escalation point for incidents, investigations, and changes
- Diagnose and remediate GPU node faults across driver, firmware, hardware, and management layers
- Maintain and troubleshoot InfiniBand, RoCE, and high-speed Ethernet fabrics
- Investigate high-performance storage data-path issues
- Conduct root cause analyses and drive long-term fixes
- Author and execute risk-assessed production changes with backout plans
- Improve dashboards, alerts, runbooks, and operational automation
- Record and resolve tickets with clear customer-impact updates
- Mentor mid-level engineers and contribute training and reviews
- Participate in on-call support and travel to sites as required