Product Lead AI ML Evals
AbridgeVisit Abridge website
Abridge is an enterprise AI platform that turns clinician-patient conversations into clinical documentation, insights, and workflow outputs for healthcare systems.
Distributed
Funding history
About Abridge
Abridge AI, Inc. provides purpose-built healthcare AI for clinical conversations, including documentation, revenue-cycle, and nursing workflows.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will own strategy, roadmap, and outcomes for the evaluation platform. You will build shared measurement infrastructure, establish evaluation standards and gates, and coordinate engineering, ML, data science, and clinical science partners.
Requirements
- 5+ years of product management experience
- Experience owning ML-powered products or platform systems
- Knowledge of evaluation frameworks, annotation pipelines, and benchmark design
- Technical fluency in ML, data pipelines, and distributed systems
- Experience working with ML researchers and engineers
- Ability to balance architectural investments with near-term quality improvements
- Experience delivering products where accuracy, reliability, and trust are critical
Responsibilities
- Drive product strategy and execution for the evaluation platform
- Own the evaluation lifecycle roadmap
- Build shared model-quality measurement infrastructure
- Define standards for LLM judges, rule-based evaluators, annotation, and monitoring
- Create repeatable model-selection processes
- Define evaluation gates and ownership across product pods
- Coordinate with data engineering, data science, clinical science, and platform teams
Benefits
- 14 paid holidays
- Flexible PTO for salaried employees
- Medical, dental, and vision coverage for full-time employees and families
- HSA contributions
- Paid parental leave
- Family-forming financial support
- 401(k) matching
- Personal device allowance
- Flexible Spending Accounts
- Commuter benefits
- Lifestyle wallet
- Therapy and coaching access
- Paid sabbatical after 5 years
- Equity grants
