Software Engineer Evals

2 weeks agoSeniorSalary: 175K - 275KPalo Alto, USAAiJobs by SpaceXAI

SpaceXAI builds frontier AI models and products including the Grok conversational assistant and a multimodal developer API.

Austin, United States
About SpaceXAI

SpaceXAI is a US-based AI company focused on accelerating scientific discovery and understanding the universe through reasoning, voice, image, video, and generative AI systems. Formerly xAI, it was acquired by SpaceX effective February 2, 2026, while continuing to operate the x.ai site and services.

View jobs by SpaceXAI

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will own and improve a research platform that supports evaluation work. You will design, build, and ship reliable systems, create evaluation instruments, support dataset cleaning and experiment feedback, track training progress, diagnose agent failures, and help design datasets and grading schemes.

Requirements

  • Software engineering proficiency
  • 3+ years actively writing code
  • Track record of shipping high-quality projects
  • Product judgment for translating quality, helpfulness, truthfulness, and safety into measurable criteria
  • Attention to detail

Responsibilities

  • Own and improve the research platform
  • Create and execute instruments for measuring model capabilities and behaviors
  • Clean datasets and provide feedback for experiments
  • Track growth throughout training
  • Diagnose agent failures and identify improvements
  • Manage execution infrastructure
  • Design datasets and grading schemes
  • Design, build, and ship reliable systems

Benefits

  • Equity
  • Medical coverage
  • Vision coverage
  • Dental coverage
  • 401(k) retirement plan
  • Short-term disability insurance
  • Long-term disability insurance
  • Life insurance
  • Discounts and perks
Software Engineer Evals at SpaceXAI | JobStash