Research Engineer - Eval Platform
Paris-based AI company building frontier models, AI applications, developer tools, and compute infrastructure for enterprise and public-sector deployments.
Maintainer signals as of 9/25/2026
About Mistral AI
Mistral AI develops open-weight and commercial language models and provides a full-stack AI platform spanning agents, application development, custom-model training, APIs, and AI cloud infrastructure.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build reproducible evaluation systems, run evaluations across GPU clusters, and create APIs and dashboards for researchers. You will detect noisy or broken evaluations, support agentic and tool-using model evaluation, and translate new research needs into shared tooling.
Requirements
- Master's or PhD in Computer Science, or equivalent experience
- 4+ years building production-grade software
- Python
- Software design, testing, code review, and CI/CD
- GPU cluster workload experience
- Slurm, Kubernetes, Ray, or similar tools
- LLM inference and evaluation familiarity
- Product mindset
Responsibilities
- Build reproducible and comparable evaluation systems
- Run model evaluations at scale across GPU clusters
- Create APIs and dashboards for evaluation results
- Detect broken or noisy evaluations
- Support evaluation of agentic, multi-turn, and tool-using models
- Turn researchers' evaluation needs into shared tooling
Benefits
- Healthcare coverage
- Parental leave
- Retirement plans
- Relocation support
- Wellness programs
- Meal allowances
- Transportation allowances