Senior Computational AI Architect
Braintrust is a decentralized talent network that connects skilled professionals and freelancers with leading companies. The platform is user-owned and controlled, utilizing the BTRST token on the Ethereum blockchain for governance, payments, and other network activities. Braintrust also offers an AI-powered recruiting platform, Braintrust AIR, to help businesses streamline their hiring process by reducing costs, eliminating bias, and identifying top talent more efficiently.
Projects
About Braintrust
Braintrust operates as a decentralized, user-owned talent network connecting skilled knowledge workers with top companies globally. The platform is built on the Ethereum blockchain and uses its native BTRST token for governance, staking, and payments, allowing talent to retain 100% of their earnings. Braintrust offers several products and services, including a Talent Marketplace and an AI-powered recruiting platform called Braintrust AIR. Braintrust AIR uses conversational AI video interviews to screen candidates, providing detailed scorecards to help companies save time, reduce costs, and eliminate bias in hiring. The platform caters to various industries, including healthcare, technology, and financial services. Braintrust fosters a strong community through its Braintrust Academy, which offers free courses, and various community programs and events. The network is governed by its community, ensuring it serves the needs of its users rather than a centralized corporation.
Skills
About the Role
You will serve as a strategic advisor for language, reasoning, and evaluation-focused AI programs. Working alongside program managers, AI strategists, and stakeholders, you will provide early-stage guidance on task design, quality standards, multilingual considerations, and evaluation methodologies, helping shape project requirements and quality expectations before execution begins. This is a remote, flexible engagement contributing to frontier AI work.
Requirements
- Master's or PhD in Computational Linguistics, NLP, Linguistics, or Cognitive Science
- 8+ years of experience
- Expertise across NLP, LLM evaluation, human annotation systems, localization, multilingual AI, and quality frameworks
- Strong written English and the ability to communicate complex ideas clearly
- Comfortable working independently in a remote environment
- Based in the United States
Responsibilities
- Develop annotation guidelines
- Create reviewer handbooks
- Design evaluator training programs
- Establish escalation frameworks
- Design evaluation rubrics
- Build reasoning-assessment frameworks
- Create multilingual quality standards
- Define quality acceptance criteria
- Review project instructions and identify ambiguity risks
- Improve linguistic consistency
- Guide localization efforts
- Assess evaluator agreement
- Review pilot outputs
- Identify systematic quality issues
- Recommend rubric improvements