Software Engineer Agent Evaluation and Quality
Anysphere, Inc. (doing business as Cursor)Visit Anysphere, Inc. (doing business as Cursor) website
Cursor is an AI coding-agent product operated by Anysphere, Inc.; it was acquired by SpaceX in August 2026 and continues to operate.
Distributed
Funding history
About Anysphere, Inc. (doing business as Cursor)
Cursor provides AI-assisted software-development tools, including desktop and CLI coding agents, autonomous cloud agents, code review, and enterprise offerings.
Skills
About the Role
You will build measurement, evaluation, and feedback-loop infrastructure for AI agents. You will create datasets, replay and scoring systems, dashboards, reliability alerts, and analysis tooling to turn user signals and agent behavior into product improvements.
Requirements
- Experience building evaluation or measurement systems
- Data analysis skills
- Ability to collaborate with data scientists and researchers
- Knowledge of model and agent behavior
- Strong software engineering fundamentals
Responsibilities
- Design and build AI evaluation systems
- Build feedback loops from real user usage
- Develop tooling to analyze and debug agent behavior
- Define quality metrics, alerts, and triage primitives
- Collect, clean, and interpret user signals
Hiring Process
2–3 short technical interviews, followed by an onsite office visit involving a small project, idea discussions, and team meetings.