Software Engineer Product

Braintrust is an active AI observability platform for teams building and operating production AI agents.

Distributed
About Braintrust

Braintrust provides tracing, evaluation, experimentation, and pattern-discovery tooling for AI agents. Teams can inspect agent traces, evaluate outputs with automated or human scoring, build datasets from production behavior, and gate releases against quality regressions.

View jobs by Braintrust

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will build user-facing product features for AI observability. You will improve UI architecture and data loading, create prompt playground and management experiences, develop a scalable human review system, and build tools for analyzing LLM outputs across large datasets.

Requirements

  • TypeScript
  • React
  • HTML
  • CSS
  • SQL
  • NextJS

Responsibilities

  • Ensure a frictionless customer experience for enabling AI observability
  • Contribute to performant UI architecture and efficient data loading patterns
  • Build a prompt playground supporting multiple models and large input volumes
  • Build prompt management, configuration, and versioned comparison features
  • Build a scalable multiplayer human review system
  • Build LLM output analysis and comparison features for large datasets

Benefits

  • Medical, dental, and vision insurance
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Equity
  • Wifi and cellphone stipend
Software Engineer Product at Braintrust | JobStash