Human Data Strategist
Reflection is an AI research lab building open frontier models and a full AI stack for developers, enterprises, and public-sector users.
Funding history
About Reflection
Reflection develops open-weight AI models, open-source software for customizing and running agents, AI-factory infrastructure, and related solutions. Its current research emphasizes large language models, reinforcement learning, and agentic reasoning.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will turn research needs into data acquisition strategies that improve AI models. You will manage data providers, define tasks and quality standards, monitor campaign performance, investigate bottlenecks, and use feedback to improve subsequent sourcing.
Requirements
- 4+ years of experience delivering complex program portfolios and prioritizing across changing research needs
- Understanding of LLM training, evaluation, and prompt design
- Proficiency in SQL for dataset querying and dashboard development
- Proficiency in Python for data analysis, API integrations, and workflow automation
- Clear written communication and stakeholder judgment
- Ability to inspect individual tasks and datasets when aggregate metrics are insufficient
Responsibilities
- Translate research plans into executable data acquisition strategies
- Assess vendor capabilities, forecast capacity, and define task instructions and acceptance criteria
- Hold vendors accountable for data quality, delivery, and cost
- Build dashboards to track throughput, turnaround time, acceptance rates, rework, and cost per accepted task
- Analyze campaign data to identify bottlenecks and guide improvements
- Surface sourcing vulnerabilities early and turn feedback into changes for subsequent sourcing
- Track how data acquisitions improve model capabilities
Benefits
- Stock options
- Comprehensive medical, dental, vision, and life insurance
- Annual wellness allowance
- Daily in-office lunch and dinner
- 22 weeks of paid parental leave
- Unlimited paid time off in the U.S.
- 30 days of vacation in the U.K.
- Visa sponsorship support
- Regular off-sites, happy hours, and team celebrations