AI Engineer Model Quality and Performance
Cerebras Systems, Inc.Visit Cerebras Systems, Inc. website
Cerebras builds wafer-scale AI computing systems and a cloud inference platform for training, fine-tuning, and serving AI models.
Series F+Recently funded
Sunnyvale, California, United States
About Cerebras Systems, Inc.
Cerebras Systems is an AI-infrastructure company founded in 2015. It sells rack-scale wafer-scale computing systems and provides cloud-based, API-accessible AI inference alongside on-premises deployments.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will own model quality and performance evaluation for inference offerings. You will design evaluation suites, use AI agents to generate and validate test cases, automate evaluation pipelines, build customer-specific benchmarks, and create tooling that combines quality and performance data.
Requirements
- Experience building AI agents using Claude or an equivalent tool
- Strong mathematics and statistics background
- Comfort with Docker, Git, and automation tooling
- Experience designing tools for non-engineering users
Responsibilities
- Design model evaluation suites using AI agents
- Build customer-specific evaluations from workload trajectories
- Automate end-to-end evaluation execution using AI-driven pipelines
- Build automations to forecast and benchmark model performance
- Build tooling that presents quality and performance data