Software Engineer Anti Abuse
ArenaVisit Arena website
Arena is a community-powered AI evaluation platform where people compare frontier-model outputs and vote, generating human-preference data and public leaderboards.
San Francisco, United States
Funding history
About Arena
Arena Intelligence, Inc. operates Arena, formerly LMArena and previously known as Chatbot Arena. Its platform measures real-world AI model performance through user comparisons, votes, leaderboards, and agentic evaluation.
Skills
About the Role
You will own anti-abuse strategy and build systems to detect, investigate, and enforce against platform misuse. You will address bots, coordinated manipulation, inference abuse, jailbreaks, high-severity harms, and account abuse while creating tooling for incident triage.
Requirements
- 6+ years of production software engineering experience
- Experience building and operating systems under adversarial conditions
- Experience in trust and safety, anti-abuse, anti-fraud, anti-spam, integrity, or risk engineering
- Strong SQL and data analysis skills
- Adversarial investigation skills
- Judgment on false positives, user harm, and enforcement reversibility
- Proficiency in Node.js, TypeScript, Python, or Go
- Excellent communication
Responsibilities
- Own the platform abuse-detection and enforcement strategy
- Design and operate detection for bots, sybils, coordinated voting, and rating manipulation
- Build reversible and auditable enforcement primitives
- Detect and mitigate inference abuse and cost exploitation
- Build misuse detection across served models
- Implement abuse monitoring for product launches
- Build detection, review, and enforcement systems for high-severity harms
- Build internal investigator tooling
- Partner on account takeover, credential stuffing, and API-key abuse
- Support acceptable-use policy and enforcement escalations
Benefits
- Equity
- Medical benefits
- Dental benefits
- Vision benefits
- Additional health and wellness support programs