Product Manager Inference Platform
Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.
Funding history
About Baseten
Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will own the end-to-end product experience for production inference infrastructure. You will define how workloads autoscale, route across regions, fail over, and scale across clusters. You will set the roadmap, shape backend behavior and customer-facing configuration and observability, and improve reliability, performance, cost efficiency, and incident recovery.
Requirements
- 8+ years of product management experience
- Deep experience with infrastructure, distributed systems, or ML serving
- Fluency with scaling, routing, failover, and cost/performance tradeoffs
- Experience owning capabilities from backend behavior through UX
- Track record of driving cross-team roadmaps and dependencies
- Comfort defining an emerging category
Responsibilities
- Own workload scaling and placement policies
- Prioritize compliance-bound workloads on sensitive capacity
- Make production inference reliable by default
- Define region-aware routing and active-active failover policies
- Build traffic-shifting capabilities for canary, shadow, and A/B releases
- Improve latency, throughput, uptime, and cost efficiency
- Reduce MTTR through self-serve incident management
- Set and own the end-to-end infrastructure product roadmap
Benefits
- Meaningful equity
- U.S. medical, dental, and vision insurance coverage for employees and dependents
- Flexible PTO
- Company-wide Winter Break
- Paid parental leave
- Fertility and family-building stipend through Carrot
- U.S. company-facilitated 401(k)