Technical Program Manager, External Evaluators

Skills

About the Role

You will be the main point of contact for Anthropic's external evaluator partners, deepening support so they can produce rigorous, independent publications. You will broaden the portfolio of evaluator organizations, manage the funnel from first conversation to published report, and turn manual processes into a scalable system. You will work with researchers and engineers to scope evaluations, define access requirements, and balance evaluator needs with security and confidentiality.

Requirements

• Experience leading complex technical programs with engineering or research teams from ambiguous goals through delivery
• Experience managing relationships with external organizations, including scoping, contracting, and resolving disagreements
• Strong program management skills including planning, milestone and dependency tracking, and risk management
• Technical fluency in how frontier AI models are trained, evaluated, and monitored
• Sound judgment and discretion with confidential and sensitive information
• Bachelor's degree or equivalent combination of education, training, and/or experience

Responsibilities

• Own the external evaluator program end to end, including relationships and the pipeline of future partners
• Take each evaluator from first conversation through scoping, contracting, onboarding, access, and review to a published report
• Define stages and tiers of working with evaluators and develop information access policies
• Drive evaluators' access and information requests to fast, well-documented decisions with Research, Security, Legal, and IT
• Drive technical design of evaluator access with Security, IT, and infrastructure teams
• Run the review process for evaluator reports against agreed timelines and redaction criteria
• Scope evaluations with researchers and engineers and plan capacity for each new evaluator
• Turn evaluators' technical findings into research and engineering work with owners and dates
• Keep the company informed with regular program updates and guidance
• Collect feedback, run retrospectives, and iterate on policies and practices
• Use Claude and work with engineering teams to build program tooling
• Share learnings to support a thriving evaluator ecosystem

Benefits

• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Visa sponsorship