Software Engineer AI ML Infrastructure

Glean is an enterprise AI platform that connects company knowledge and systems to provide permission-aware search, AI assistance, and agents.

San Francisco, United States
About Glean

Glean develops enterprise Work AI software. Its platform provides enterprise search, a conversational AI assistant, and tools to build, govern, and orchestrate AI agents using a company’s connected data and permissions.

View jobs by Glean

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will design, build, and improve AI/ML systems and data-pipeline infrastructure. You will develop platforms for large-language-model serving, routing, and orchestration at scale, build agentic systems for infrastructure health, write maintainable tested code, and mentor junior engineers.

Requirements

  • 2–6 years of experience
  • Bachelor's degree in computer science, mathematics, science, or a related field
  • Ability to design, build, and ship production-ready software
  • AI/ML infrastructure experience, including batch-processing pipelines or serving infrastructure
  • Python, Go, or Java coding skills

Responsibilities

  • Design, build, and improve AI/ML systems and data-pipeline infrastructure
  • Build platforms for large language model serving, routing, and orchestration at scale
  • Enable engineers working on modeling and agentic capabilities
  • Build agentic systems that monitor, diagnose, debug, and maintain infrastructure health across cloud deployments
  • Write robust, maintainable, and testable code
  • Mentor junior engineers

Benefits

  • Medical coverage
  • Vision coverage
  • Dental coverage
  • Generous time-off policy
  • 401k plan
  • Home office improvement stipend
  • Annual wellness stipend
  • Regular company events
  • Daily healthy lunches

Hiring Process

Brief AI-focused exercise or discussion during the interview process.

Software Engineer AI ML Infrastructure at Glean | JobStash