Data Scientist, Agent
AI app builder that turns natural-language prompts into full-stack web applications.
Maintainer signals as of 8/14/2026
Stockholm, Sweden
About Lovable
Lovable (lovable.dev) is a Swedish AI software-builder platform: users describe an app in natural language and Lovable generates production full-stack code — one of the fastest-growing AI products.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will own the measurement and improvement of an AI agent. You will define quality metrics, build evaluation and experimentation systems, analyze agent traces and telemetry, identify regressions, and work with engineering to improve success rates, task completion, and error rates.
Requirements
- Experience or strong interest in LLM evaluation and observability
- Strong SQL and Python
- Applied statistics
- Experimentation and A/B testing
- Ability to design experiments with noisy outcomes
- Ability to measure agent behavior without a clean answer key
- Entrepreneurial approach
- Ability to work closely with agent engineers
Responsibilities
- Define and own agent quality metrics
- Build evaluation systems and experiment frameworks
- Determine whether agent changes should ship
- Analyze agent traces and telemetry
- Identify concrete fixes with the agent engineering team
- Build tooling and agents for continuous evaluations
- Set standards for judging agent behavior without an answer key