Software Engineer, AI Accelerator Runtime

Skills

About the Role

You will build the low-level device runtime that turns compiled programs into efficient execution on a custom AI accelerator. You will schedule kernel launches, manage device memory, coordinate synchronization, and expose reliable abstractions to higher-level runtimes. You will work at the boundary of software and hardware with compiler, kernel, architecture, verification and silicon teams, and use cycle-accurate simulation to develop and debug runtime capabilities before silicon is available.

Requirements

• Strong low-level systems programming experience in C, C++, Rust, or comparable environments
• Experience building runtimes, drivers, firmware, OS components, accelerator software, or systems infrastructure
• Understanding of concurrency, synchronization, asynchronous execution, queues, events, and memory-ordering semantics
• Understanding of memory management, address spaces, DMA, caching, coherency, and hardware-software interfaces
• Hands-on experience with event-based, cycle-accurate simulators or related performance models
• Ability to reason quantitatively about scheduling, latency, throughput, utilization, and contention
• Skilled at debugging failures across software and hardware boundaries
• Work effectively across compiler, kernel, architecture, verification, firmware, and silicon teams

Responsibilities

• Design and implement the low-level device runtime for custom silicon
• Build kernel-launch scheduling, command submission, queueing, dependency tracking, and completion handling
• Manage device memory spaces, allocation, virtual-to-physical mappings, data movement, and lifetime
• Implement synchronization primitives, events, barriers, streams, and ordering guarantees
• Define clean interfaces between the runtime, drivers, firmware, compiler-generated code, kernels, and higher-level systems
• Use event-based, cycle-accurate simulators to develop, validate, debug, and tune runtime behavior
• Diagnose concurrency, memory-ordering, deadlock, race, correctness, and performance issues
• Build tests, tracing, profiling, observability, and reproducible workloads
• Partner with architecture and silicon teams to improve hardware-software interfaces

Benefits

• Medical, dental, and vision insurance with employer HSA contributions
• Pre-tax Health FSA, Dependent Care FSA, and commuter accounts
• 401(k) with employer match
• Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents) plus paid medical and caregiver leave (up to 8 weeks)
• Flexible PTO for exempt employees; up to 15 days annually for non-exempt employees
• 13+ paid company holidays and paid company office closures
• Paid sick or safe time
• Mental health and wellness support
• Employer-paid basic life and disability coverage
• Annual learning and development stipend
• Daily meals in offices and meal delivery credits
• Relocation support for eligible employees
• Charitable donation matching and wellness stipends
• Equity
• Performance-related bonus