Machine Learning Engineer
Arena is a community-powered AI evaluation platform where people compare frontier-model outputs and vote, generating human-preference data and public leaderboards.
Funding history
About Arena
Arena Intelligence, Inc. operates Arena, formerly LMArena and previously known as Chatbot Arena. Its platform measures real-world AI model performance through user comparisons, votes, leaderboards, and agentic evaluation.
Skills
About the Role
You will help scale the core infrastructure behind real-world AI evaluation. You will architect core modeling for data and evaluation products, own data, model training and eval pipelines, work across data pipelines and inference APIs, and research state-of-the-art evaluation methods while partnering with researchers, engineers and product leadership.
Requirements
- Strong programming skills across the stack in a recommendation system or LLM stack
- Experience in deep learning, language models or reward model training
- Experience with LLM fine tuning, prompt engineering, function calling
- Self-motivated with willingness to take ownership
- Passion for shipping quality products
- 4+ years of industry experience or relevant projects
- Solid understanding of statistics and evaluating uncertainty
Responsibilities
- Architect and build core modeling for data and evaluation products
- Own the full stack data, model training, and eval pipelines
- Help grow a culture of feedback and rapid product iteration
- Research state-of-the-art evaluation methods and contribute to a centralized, scalable evaluation platform
Benefits
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs