Staff AI Product Engineer

15 hours agoLeadSalary: 220K - 293KHouston; New York; San Francisco; Seattle Hybrid Ai Jobs by Nscale

Nscale

Nscale is a London-based, full-stack AI cloud and infrastructure company that provides GPU compute, managed AI services, orchestration software, data centers, and power infrastructure for AI training, fine-tuning, and inference.

Series CRecently fundedCompany intelligence

London, United Kingdom

Funding history

Ward County and Madison senior secured delayed draw term loan facilitiesRevolving Credit FacilityNarvik AI data center financing

Investors

abn amro Nvidia Jane Street Deutsche Bank Lenovo

About Nscale

Nscale builds and operates vertically integrated AI infrastructure spanning software, GPU compute, networking, storage, purpose-built data centers, and power. Its active cloud platform offers self-service inference endpoints, fine-tuning, managed Kubernetes and Slurm, virtual machines, and GPU clusters.

View jobs by Nscale

Skills

Api Architecture Cloud Control Plane Cost Data Plane Distributed System Error Budget Gpu Machine Learning On-Call Platform Engineering Provisioning Reliability Sdk Slo Terraform

Candidate Availability

Hybrid · Houston; New York; San Francisco; Seattle · Required

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will set architecture and engineering standards across the AI product platform. You will drive decisions on APIs, service boundaries, data models, performance, reliability, cost, developer experience, and build-versus-buy choices. You will coach senior engineers and align technical strategy with product direction.

Requirements

8–12 years of software engineering experience
Experience setting technical direction across teams
Expertise in API design, platform engineering, and distributed systems
Experience designing cloud services with control-plane and data-plane separation
Experience building developer-facing platforms
Experience defining provisioning contracts and dependency-ordered service composition
Experience with versioning and compatibility policy
Production ownership and on-call experience
Experience with SLOs, error budgets, incident review, and reliability measurement
Experience with cost attribution and cost controls
Cross-team influence

Responsibilities

Set technical direction across the AI product platform
Drive cross-team architecture decisions for services, APIs, data models, and standards
Lead systemic improvements to performance, reliability, cost, and developer experience
Resolve ambiguous system-level technical problems
Coach Senior AI Product Engineers
Align technical strategy with product leadership and engineering management
Evaluate build-versus-buy decisions
Represent product engineering in architecture reviews

Benefits

Medical coverage
Dental coverage
Vision coverage
Flexible paid time off
Parental leave
Retirement plan participation