Helix AI Engineer Training Performance

2 months agoSeniorSalary: 200K - 400KSan Jose, CAFull TimeAiJobs by Figure

Figure is an AI robotics company developing general-purpose humanoid robots, embodied AI, and data-collection services for home and commercial use.

San Jose, United States
About Figure

Figure develops the Figure 03 humanoid robot and Helix, its vision-language-action AI system, to autonomously perform household and commercial tasks. It also operates Index, a contributor network and app for collecting real-world task data.

View jobs by Figure

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will optimize large-scale model training across GPU clusters, develop custom kernels, improve data pipelines and fault tolerance, and build performance-monitoring tooling. You will evaluate accelerator architectures and tune distributed parallelism for efficient training.

Requirements

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field
  • 3+ years in AI performance engineering
  • Understanding of GPU architecture and performance characteristics
  • Proficiency with Nsight Systems, Nsight Compute, PyTorch Profiler, HTA, or similar profiling tools
  • Knowledge of NCCL, RDMA, NVLink, InfiniBand, RoCE, and topology-aware placement
  • Python and CUDA/C++ skills
  • Experience debugging performance regressions and instability at scale
  • Experience using MFU or HFU hardware-efficiency metrics

Responsibilities

  • Optimize training performance for 100B+ parameter models across 100k+ GPUs
  • Inform accelerator, cluster topology, scheduling, and hardware procurement decisions
  • Write and optimize Triton and CUDA kernels
  • Build tooling and dashboards for performance monitoring, regression detection, and root-cause analysis
  • Optimize data loading and preprocessing pipelines
  • Improve checkpointing, fault tolerance, and elastic restart
  • Co-design performant model architectures and training recipes
  • Contribute to kernel compilers
  • Build agentic systems for generating and benchmarking custom kernels
  • Evaluate accelerator architectures and lead proof-of-concept ports and benchmarks
  • Explore model and data parallelism configurations
Helix AI Engineer Training Performance at Figure | JobStash