Principal System Software Engineer AI Inference Execution

AI-infrastructure company producing memory-centric hardware, networking, and software for low-latency generative-AI inference in data centers.

Santa Clara, United States
About d-Matrix

d-Matrix develops digital in-memory-compute technology and a full-stack inference platform comprising Corsair accelerators, JetStream networking accelerators, and Aviator software.

View jobs by d-Matrix

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will develop, enhance, and maintain next-generation AI deployment software. You will productize the software stack, optimize hardware-software trade-offs, build deployment infrastructure, and scale software deliverables for distributed machine-learning workloads.

Requirements

  • BS in Computer Science, Engineering, Math, Physics, or a related field with 12+ years of industry software development experience
  • Strong knowledge of system software, data structures, computer architecture, and machine learning fundamentals
  • Proficiency in C/C++/Python development in Linux environments
  • Experience designing and implementing distributed high-performance software
  • Leadership and ownership

Responsibilities

  • Develop, enhance, and maintain AI deployment software
  • Productize the software stack for the AI compute engine
  • Optimize hardware-software co-design trade-offs
  • Build deployment infrastructure
  • Build and scale software deliverables within tight timelines

Benefits

  • Equity
  • Bonus
  • Performance-based incentive opportunities
  • Medical insurance
  • Dental insurance
  • Vision insurance
  • 401k
Principal System Software Engineer AI Inference Execution at d-Matrix | JobStash