Architecture & Performance Modeling Engineer, AI Inference Silicon

Skills

About the Role

You will help shape the architecture of next-generation AI inference accelerators. You will work with chip architects to explore options, quantify tradeoffs, identify bottlenecks and turn modeling results into design recommendations. You will build and maintain analytical, transaction-level and cycle-level models in a Rust simulator, evaluate LLM inference workloads, and correlate predictions against RTL simulation, emulation or silicon measurements.

Requirements

• 5+ years in computer architecture, microarchitecture or performance modeling for accelerators, CPUs or GPUs
• Experience using models to influence architectural decisions
• Strong understanding of pipelines, queues, parallel execution, memory hierarchies, data movement and interconnects
• Hands-on experience building analytical, transaction-level or cycle-level performance models
• Comfort working with incomplete specifications
• Strong Rust skills or expert C/C++ with willingness to use Rust, and Python proficiency
• Ability to read SystemVerilog RTL and verification results
• Excellent communication skills

Responsibilities

• Partner with architects to turn design questions into focused modeling studies
• Perform what-if analysis across compute engines, memory, dataflow, DMA, command processing, on-chip interconnect and chip-to-chip communication
• Compare architectural options and recommend changes within system, power, area and implementation constraints
• Evaluate AI inference workloads across prefill and decode, batch sizes, context lengths, and dense and mixture-of-experts models
• Communicate findings and update studies as workloads and architecture evolve
• Develop and extend analytical, transaction-level and cycle-level models
• Maintain reusable models in the Rust simulator and correlate against RTL simulation, emulation or silicon measurements

Benefits

• Fully company-paid medical, dental and vision insurance for you and dependents
• Company-paid life and disability coverage
• Supplemental hospital, critical illness and accident coverage available
• Unlimited paid time off
• 13 paid company holidays
• Remote-first culture with company-provided computer and home office setup
• Equity
• 401(k) with company matching from day one