Senior Staff Applied Scientist

2 days agoLeadSalary: 180K - 330KSan Francisco, USAHybridAiJobs by Glean

Glean is an enterprise AI platform that connects company knowledge and systems to provide permission-aware search, AI assistance, and agents.

San Francisco, United States
About Glean

Glean develops enterprise Work AI software. Its platform provides enterprise search, a conversational AI assistant, and tools to build, govern, and orchestrate AI agents using a company’s connected data and permissions.

View jobs by Glean

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will develop and maintain an A/B experimentation platform, identify techniques and process improvements, and deploy scalable evaluation tools. You will design end-to-end and task-level evaluations for AI use cases, establish evaluation practices, apply statistical methods, define product metrics, and analyze data for strategic insights.

Requirements

  • 5+ years of experience with a Master’s degree or 3+ years with a PhD
  • Master’s or PhD in Statistics, Mathematics, Computer Science, or another quantitative field
  • Statistics or machine learning expertise
  • Python proficiency
  • SQL proficiency
  • Modern data-stack experience
  • DBT pipeline experience
  • Product KPI, guardrail metric, dashboarding, and data-analysis experience
  • B2B SaaS experience
  • Ranking, A/B experimentation-platform, or ML-measurement experience

Responsibilities

  • Collaborate on A/B experimentation techniques, tooling, and process improvements
  • Develop and maintain the A/B experimentation platform
  • Deploy scalable evaluation techniques and tools
  • Conduct end-to-end evaluations for AI use cases
  • Design granular evaluations for AI tasks and skills
  • Develop evaluation practices, tools, and processes
  • Standardize statistical principles for LLM stochasticity
  • Develop industry benchmarks
  • Define product KPIs and guardrail metrics
  • Analyze raw data for strategic insights

Benefits

  • Medical coverage
  • Vision coverage
  • Dental coverage
  • Generous time-off policy
  • 401k plan
  • Home office improvement stipend
  • Annual education stipend
  • Annual wellness stipend
  • Regular events
  • Healthy lunches

Hiring Process

Brief AI-focused exercise or discussion.

Senior Staff Applied Scientist at Glean | JobStash