Product Manager, Inference Experience

Skills

About the Role

You will own the experience of building on Baseten, from discovering and evaluating models to deploying and operating them in production. You'll shape products like Model APIs, Dedicated Inference, Model Evaluations, and the Model Library, working with engineering, research, and GTM.

Requirements

• 10+ years building and shipping AI/ML products or platforms
• Technical background in software engineering, ML engineering, research, or equivalent
• Direct experience building or deploying models using PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo, or similar
• Strong understanding of model serving, GPU economics, and quality, latency, throughput, cost tradeoffs
• Exceptional developer product instincts
• Track record of leading cross-functional product initiatives and driving adoption or revenue growth

Responsibilities

• Own product strategy and roadmap across inference offerings
• Make it easier for developers to discover, evaluate, deploy, and manage AI models through APIs, SDKs, CLI, and console
• Work with inference engineers and researchers to turn technical advances into customer-facing capabilities
• Help determine which models, workloads, and customer needs to prioritize
• Partner with GTM and leadership on pricing, packaging, launches, and commercialization
• Spend time with developers and customers to understand what to build next

Benefits

• Equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
• Flexible PTO policy including company-wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k) (U.S. only)