Workstream Lead Agentic AI Risk Modelling and Mitigations
UK government research organisation that evaluates advanced AI risks and develops and tests mitigations to inform governments.
Funding history
Investors
About The AI Security Institute (AISI)
The AI Security Institute is a research organisation within the UK Department for Science, Innovation and Technology. It tests leading AI systems, conducts technical research on advanced-AI risks and solutions, develops evaluation infrastructure, and informs UK and allied-government policy.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will set the strategy, research agenda, and scientific direction for agentic AI risk modelling and mitigations. You will develop analyses and practical mitigations, support their adoption by relevant UK organisations, lead and develop a multidisciplinary team, and build relationships with senior policy and technical stakeholders.
Requirements
- Experience leading impactful research, scientific work, or technical programmes relevant to frontier AI, AI safety, AI governance, risk analysis, or a related field
- Strategic judgement on advanced AI risks
- Experience setting and delivering research agendas or analytical programmes in technically complex environments
- Ability to lead rigorous analytical or scientific work and critically review outputs
- Experience translating technical or research findings into practical recommendations, operational interventions, or policy-relevant outputs
- Experience leading and line-managing high-performing multidisciplinary teams
- Experience building relationships with senior stakeholders in complex institutional environments
- Written and verbal communication skills for technical and non-technical audiences
- Expertise in AI control, alignment, model autonomy, scenario analysis, systemic risk, or frontier AI governance
- Understanding of frontier AI timelines, advanced AI risk, or loss of control
- Experience designing or evaluating mitigations for high-consequence technical risks
- Background in machine learning, computer science, engineering, mathematics, economics, public policy, security studies, or a relevant discipline
- Familiarity with government decision-making, national security, or assurance processes
- Obtain a criminal record check and Baseline Personnel Security Standard clearance before appointment
- Be eligible for Counter-Terrorist Check clearance, which is strongly preferred
Responsibilities
- Set the team's strategy, quarterly plan, and research agenda
- Lead the scientific direction of risk modelling, including selecting approaches, developing scenarios, and reviewing outputs
- Develop analyses of advanced AI oversight, correction, and shutdown risks
- Identify practical ways to reduce advanced AI risks
- Turn research into assessments, mitigations, and implementation pathways
- Work with relevant UK organisations to support mitigation adoption
- Hire, line-manage, and develop a multidisciplinary team
- Maintain high standards across multiple workstreams
- Build relationships with senior policy and technical stakeholders across government, research organisations, and frontier AI companies
- Work with research leaders on priorities, quality, and delivery
Benefits
- Hybrid working
- Flexibility for occasional remote work abroad
- Work-from-home equipment stipend
- At least 25 days of annual leave
- Eight public holidays
- Extra team-wide breaks
- Three days of volunteering leave
- Paid parental leave
- Employer pension contribution of 28.97% of base salary
- Cycling, donation, retail, and gym discounts and benefits