AI Data Analyst
Glean is an enterprise AI platform that connects company knowledge and systems to provide permission-aware search, AI assistance, and agents.
Funding history
About Glean
Glean develops enterprise Work AI software. Its platform provides enterprise search, a conversational AI assistant, and tools to build, govern, and orchestrate AI agents using a company’s connected data and permissions.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will evaluate AI outputs and label failure modes across priority workflows. You will maintain benchmark datasets and regression slices, analyze recurring quality issues, improve labeling rubrics, calibrate human and automated evaluations, and partner with QA, Engineering, Product, and evaluation owners on release-readiness decisions and quality reporting.
Requirements
- 3–5 years of experience in data labeling, data analysis, QA, or a related field
- Analytical judgment and attention to detail
- Experience evaluating AI-generated outputs or working with ML systems
- Structured qualitative analysis, basic SQL/data retrieval, and spreadsheet workflows
- Written and verbal communication skills
- Ability to work independently and collaborate across functions
Responsibilities
- Run human labeling for priority AI workflows
- Triage quality reports and categorize failure modes
- Analyze recurring quality issues
- Improve labeling guidelines and rubrics
- Maintain labeled datasets, golden sets, and regression slices
- Participate in grader calibration and validate LLM-as-a-judge outputs
- Partner on quality reads, benchmark updates, and release-readiness decisions
- Surface quality shifts and actionable recommendations in recurring reporting
Hiring Process
Brief AI-focused exercise or discussion as part of the interview process.