Senior Software Engineer, AI Platform

Harvey is an AI platform for legal and professional-services organizations.

Series F+Recently funded
Distributed
About Harvey

Harvey provides agents and collaborative tools for legal work, including legal research, document analysis, secure workspaces, contract intelligence, and organization-level analytics.

View jobs by Harvey

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will design and build abstractions and platform systems that power Harvey's agentic products, own infrastructure for model integration, routing and evaluation, build eval frameworks and tooling, and partner with product engineering, PMs and design while integrating the latest AI advancements.

Requirements

  • 6+ years building backend systems, with 1+ year in AI/ML engineering
  • Experience building and shipping multi-model or multi-provider AI systems in production
  • Familiarity with context management, session state or memory systems
  • Track record building internal platforms, SDKs or shared infrastructure
  • Strong judgment about abstractions
  • Excitement about agentic AI
  • Bias toward full ownership

Responsibilities

  • Design and build abstractions and platform-level systems for agentic products
  • Own infrastructure for model integration, routing and evaluation
  • Build evaluation frameworks and tooling
  • Partner with product engineering teams, PMs and design to launch AI products
  • Evaluate, prototype and integrate new AI and agentic advancements

Benefits

  • Equity
Senior Software Engineer, AI Platform at Harvey | JobStash