AI Engineer Quality and Post Training
Glean is an enterprise AI platform that connects company knowledge and systems to provide permission-aware search, AI assistance, and agents.
Funding history
About Glean
Glean develops enterprise Work AI software. Its platform provides enterprise search, a conversational AI assistant, and tools to build, govern, and orchestrate AI agents using a company’s connected data and permissions.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will use evaluation results and production traces to improve agent systems, model routing, prompts, and retrieval. You will post-train models, build simulation environments and verifiers, calibrate quality signals, and bring production quality improvements to product workflows.
Requirements
- AI engineering
- machine learning engineering
- LLM post-training
- open-weight model
- evaluation
- AI assistant
- agent system
- LLM-as-a-judge
- Python
- Go
- TypeScript
- machine learning framework
- production machine learning system
Responsibilities
- Use evaluation results and production traces to improve agent harnesses, model routing, prompts, and retrieval.
- Post-train models using supervised fine-tuning and preference- or reward-based optimization.
- Generate training data for model post-training.
- Build reinforcement-learning environments, evaluation datasets, harness support, and LLM verifiers.
- Improve and calibrate evaluation datasets, LLM judges, and agentic verifiers.
- Land production quality improvements with product, platform, and research partners.
Benefits
- Medical coverage
- Vision coverage
- Dental coverage
- Generous time-off policy
- 401k plan
- Home office improvement stipend
- Annual education stipend
- Annual wellness stipend
- Regular events
- Daily healthy lunches
Hiring Process
AI-focused exercise or discussion.