Senior Staff Software Engineer Kernels
d-MatrixVisit d-Matrix website
AI-infrastructure company producing memory-centric hardware, networking, and software for low-latency generative-AI inference in data centers.
Santa Clara, United States
Funding history
About d-Matrix
d-Matrix develops digital in-memory-compute technology and a full-stack inference platform comprising Corsair accelerators, JetStream networking accelerators, and Aviator software.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will develop, enhance, and maintain software kernels for next-generation AI hardware. You will map algorithms and computational graphs to hardware architectures, optimize hardware-software trade-offs, and help build compiler infrastructure for machine-learning workloads.
Requirements
- MS in computer engineering, math, physics, or a related degree with 10+ years of industry experience, or a PhD in a related field with 1+ years of industry experience
- Knowledge of computer architecture, data structures, system software, and machine learning fundamentals
- Proficiency in C/C++ and Python development in Linux environments
- Experience implementing algorithms in C/C++ and Python
- Experience developing algorithms for FPGAs, DSPs, GPUs, or AI accelerators using CUDA or similar libraries
- Experience implementing ML operators including GEMMs, convolutions, BLAS, SIMD, softmax, layer normalization, and pooling
- Experience developing for embedded SIMD vector processors such as Tensilica
Responsibilities
- Develop, enhance, and maintain software kernels for AI hardware
- Map algorithms to hardware architectures
- Map AI-framework computational graphs to underlying hardware
- Optimize hardware-software co-design trade-offs
- Build and scale software deliverables within tight timelines
- Help build compiler infrastructure