Principal AI Infrastructure Engineer
Hut 8 is an energy infrastructure platform that develops and operates power, digital infrastructure, and compute assets. Its platform supports energy-intensive technologies, including AI and Bitcoin mining.
Funding history
About Hut 8
Hut 8 develops, commercializes, and operates an integrated portfolio of power, digital infrastructure, and compute assets. It manages energy assets such as powered land, interconnects, substations, and switchyards; operates purpose-built facilities for energy-intensive applications; and deploys specialized hardware for technologies including AI and Bitcoin mining.
Skills
About the Role
You will lead the bring-up of GPU compute clusters from installation through production readiness and customer handoff. You will validate system baselines, optimize provisioning and Linux/GPU performance, integrate Kubernetes and Slurm, run diagnostics and benchmarks, resolve Tier 3 incidents, perform root-cause analysis, and create tooling, automation, runbooks, and operational handoff materials.
Requirements
- Bachelor's degree in computer science, engineering, a related field, or equivalent practical experience
- 8+ years of hands-on Linux systems engineering, HPC, cloud, or large-scale infrastructure experience
- Experience bringing GPU or HPC clusters into production and qualifying systems against performance and reliability targets
- Expertise in Linux, Python, Bash, Ansible, bare-metal provisioning, configuration management, and systems diagnostics
- Experience with NVIDIA GPU platforms, NCCL, Field Diagnostics, and multi-node performance testing
- Experience with Kubernetes and Slurm
- Familiarity with high-speed Ethernet, InfiniBand, RDMA, and parallel or distributed storage
Responsibilities
- Lead technical bring-up of racked, powered, and cabled AI clusters through production readiness and customer handoff
- Establish and validate BIOS, BMC, firmware, GPU driver, operating system, and cluster software baselines
- Deploy and optimize automated bare-metal provisioning, imaging, configuration, and lifecycle workflows
- Configure and troubleshoot Linux and GPU systems
- Integrate and validate Kubernetes and Slurm environments
- Execute NVIDIA Field Diagnostics, validation, burn-in, stability, and hardware health qualification procedures
- Run and analyze NCCL tests, GPU benchmarks, and distributed workload performance
- Troubleshoot GPU, NVLink, NVSwitch, PCIe, RDMA, and InfiniBand or Ethernet performance issues
- Own technical acceptance criteria, test evidence, defect tracking, remediation verification, and readiness recommendations
- Serve as a senior escalation point for complex production incidents
- Perform root-cause analysis and coordinate vendor engineering escalations
- Develop diagnostic tooling, automation, runbooks, and operational handoff material