AI Behavior Engineer
Independent nonprofit AI research lab building open technology for understanding and scalable public oversight of AI systems.
About Transluce
Transluce develops research, platforms, and tools to help people understand, evaluate, and steer advanced AI systems in the public interest. Its active offerings include Docent, a behavior-analysis platform for AI-agent transcripts, and Monitor, an AI-driven interface for observing and steering model computations.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, prototype, and run behavioral AI evaluations for emerging policy and oversight needs. You will deliver evaluations for government and civil-society partners, conduct privileged-access oversight exercises with frontier labs, and adapt evaluation pipelines with domain experts.
Requirements
- Experience designing and running AI evaluations
- Experience with behavioral, interactive, multi-turn, agentic, or red-teaming evaluations
- Strong engineering judgment
- Customer-facing, consulting, or forward-deployed experience
- Experience running evaluations at scale or in production
- Ability to balance researcher, domain-expert, and decision-maker needs
- Strong communication and feedback skills
Responsibilities
- Scope, prototype, and run behavioral AI evaluations
- Respond to emerging policy and oversight needs
- Execute evaluation contracts with government evaluators
- Build evaluations for harmful manipulation
- Design and run privileged-access evaluations
- Conduct external oversight exercises with frontier labs
- Adapt behavioral evaluation pipelines with civil society organizations and domain experts