Software Engineer, Accelerators

Skills

About the Role

You will help evaluate and bring up new compute platforms for large-scale AI training and inference. You'll prototype system software on new accelerators, develop kernels and sharding strategies, optimize LLMs and distributed workloads, perform performance modeling, and work with hardware teams and vendors to adapt the software stack to non-traditional hardware. This role bridges ML algorithms with system performance and is not compiler-focused.

Requirements

• 3+ years of experience in AI infrastructure including kernels, systems, or hardware-software co-design
• Hands-on experience with data center scale AI accelerator platforms (e.g., TPUs, custom silicon)
• Strong understanding of kernels, sharding, runtime systems, or distributed scaling
• Familiarity with optimizing LLMs, CNNs, or recommender models
• Experience with performance modeling, system debugging, and software stack adaptation
• Ability to operate across multiple levels of the stack and prototype rapidly
• May need to meet legal status requirements under U.S. export control laws

Responsibilities

• Prototype and enable the AI software stack on new exploratory accelerator platforms
• Optimize large-scale model performance (LLMs, recommender systems, distributed workloads) across diverse hardware
• Develop kernels, sharding mechanisms, and system scaling strategies for emerging accelerators
• Optimize model code (e.g. PyTorch) and below for non-traditional hardware
• Perform system-level performance modeling, debug bottlenecks, and drive end-to-end optimization
• Work with hardware teams and vendors to evaluate alternatives and adapt the software stack
• Contribute to runtime improvements, compute/communication overlapping, and scaling efforts

Benefits

• Equity
• Medical, dental, and vision insurance with employer HSA contributions
• Pre-tax Health FSA, Dependent Care FSA, and commuter accounts
• 401(k) with employer match
• Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents)
• Paid medical and caregiver leave (up to 8 weeks)
• Flexible PTO for exempt employees
• 13+ paid company holidays and company office closures
• Paid sick or safe time
• Mental health and wellness support
• Employer-paid basic life and disability coverage
• Annual learning and development stipend
• Daily meals in offices and meal delivery credits
• Relocation support for eligible employees
• Charitable donation matching and wellness stipends
• Performance-related bonus