Software Engineer Agentic Runtime

Glean is an enterprise AI platform that connects company knowledge and systems to provide permission-aware search, AI assistance, and agents.

San Francisco, United States
About Glean

Glean develops enterprise Work AI software. Its platform provides enterprise search, a conversational AI assistant, and tools to build, govern, and orchestrate AI agents using a company’s connected data and permissions.

View jobs by Glean

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will design, launch, and operate runtime services for multi-turn orchestration, tool execution, model routing, memory, streaming, and safety. You will improve latency, reliability, observability, and cost; integrate LLM providers and evaluation frameworks; harden production systems; and create high-availability playbooks and SLOs.

Requirements

  • 3+ years of software engineering experience building production distributed systems or cloud-native applications
  • Computer Science degree or equivalent practical experience
  • Coding skills in Python, Go, Java, JavaScript, TypeScript, or C++
  • Experience operating services on Kubernetes and a major cloud platform
  • Familiarity with streaming systems, caching, and low-latency data stores
  • Understanding of LLM and agent building blocks
  • Observability and debugging skills

Responsibilities

  • Own runtime architecture, design, production launch, and reliability
  • Build core services for sessions, streaming, tool execution, memory, and guardrails
  • Optimize latency, correctness, reliability, and cost
  • Integrate LLM providers and evaluation frameworks
  • Implement fault isolation, retries, timeouts, circuit breaking, backpressure, and graceful degradation
  • Instrument tracing, metrics, and logs
  • Create playbooks and SLOs for high availability
  • Collaborate on roadmap priorities

Benefits

  • Medical coverage
  • Vision coverage
  • Dental coverage
  • Generous time-off policy
  • 401k plan
  • Home office improvement stipend
  • Annual education stipend
  • Annual wellness stipend
  • Regular company events
  • Daily healthy lunches

Hiring Process

Brief AI-focused exercise or discussion as part of the interview process.