Senior Advisor for Advanced Guardrails for AI-Induced Incidents

Institute for Security and Technology logo
Institute for Security and TechnologyVisit Institute for Security and Technology website

A 501(c)(3) nonprofit think tank that convenes technology, policy, and industry leaders to develop actionable security solutions, including work on AI risk, cybersecurity, and strategic stability.

Oakland, California, United States
About Institute for Security and Technology

Institute for Security and Technology (IST) is a nonprofit “critical action think tank” focused on national security and global stability through trustworthy technology. Its current work includes AI risk reduction and AI-national-security policy, cybersecurity, critical-infrastructure resilience, and nuclear command, control, and communications.

View jobs by Institute for Security and Technology

Skills

About the Role

In this contract role, you will provide strategic and technical advice on advanced AI risks, safeguards, incident prevention, and loss-of-control contingency planning. You will conduct research and adversarial analysis, assess prevention and response mechanisms, convene stakeholders, facilitate expert exercises, and turn technical evidence into practical policy and operational recommendations.

Requirements

  • Advanced degree in Computer Science, Machine Learning, AI Safety, or a related technical field
  • At least five years of experience with red teaming, threat modeling, or technical AI governance
  • Familiarity with AI loss-of-control research, AI control, model evaluations, agent security, containment, monitoring, or related safeguards
  • Track record of convening multidisciplinary experts and producing technical or policy research
  • Experience developing response frameworks, escalation processes, or scenario-based exercises for high-consequence situations
  • Ability to translate technical risk into practical operational guidance for technical and policy audiences
  • Analytical, writing, and facilitation skills
  • Experience engaging government and industry stakeholders

Responsibilities

  • Provide strategic and technical guidance on advanced AI risks, safeguards, and incident prevention
  • Lead and contribute to research on emerging AI capabilities, risks, and potential loss-of-control scenarios
  • Assess technical and institutional approaches for preventing, detecting, and mitigating high-consequence AI incidents
  • Identify gaps in existing safeguards and areas needing additional technical or governance measures
  • Engage researchers, AI developers, government stakeholders, and other experts
  • Convene and support expert discussions, workshops, and structured analytical exercises
  • Translate technical research and evidence into actionable policy and practice recommendations
  • Contribute to publications, briefings, and external engagements on AI risk reduction and preparedness