We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

ML Engineer, Retrieval & Grounded Generation

Venture studio that launches, operates, and scales technology companies across healthcare, cyber, and national security.

McLean, Virginia, United States
About Red Cell Partners

Red Cell Partners is an active McLean, Virginia-based venture studio founded in 2020. It creates, incubates, operates, and scales mission-critical technology companies across healthcare, cyber, and national security, with both incubation and investment activities.

View jobs by Red Cell Partners

Skills

Candidate Availability

About the Role

You will own quality for an AI-enabled decision-support system: the test plan, the automated coverage, and the evidence that what was delivered matches what was specified. You will turn product acceptance criteria into executable tests, build automation integrated into CI/CD as release gates, run performance and load testing, build labeled evaluation sets and sampled audits, and maintain release governance records. You report through the Product Lead while working daily with engineering and platform. The role is fully remote with occasional travel of up to 25%.

Requirements

  • 5+ years in software quality engineering, test automation, or software engineering with substantial test ownership
  • Strong coding ability in a test automation language and framework such as Python with pytest, or JavaScript/TypeScript with Playwright, Cypress, or Selenium
  • Routine use of AI-assisted development
  • Experience building automated test suites integrated into CI/CD as release gates
  • Experience owning a test plan through review and acceptance
  • Experience with performance and load testing
  • Working statistical literacy including sampling design
  • Experience measuring what a system misses
  • Ability to gate work owned by people who do not report to you
  • Clear, audit-ready written documentation
  • US Citizenship required
  • Active US Secret clearance with CAC eligibility
  • Willingness to travel up to 25%

Responsibilities

  • Own the system test plan covering functional, integration, performance, and load testing
  • Translate product acceptance criteria into executable tests
  • Review acceptance criteria with product before development and flag ambiguous or unverifiable requirements
  • Hold engineering, platform, and partner teams accountable to acceptance criteria
  • Plan and coordinate user acceptance testing with the customer and track findings to resolution
  • Build and maintain automated test suites integrated into CI/CD as release gates
  • Establish and report against an automated coverage standard
  • Build performance and load testing under expected user load
  • Maintain regression coverage across releases
  • Build and maintain labeled evaluation sets with subject-matter experts
  • Design and run sampled audits confirming automated decisions were correct
  • Measure and report what the system misses and how often users override it
  • Document how each committed measure is computed
  • Maintain the version inventory across builds, models, configurations, and thresholds
  • Produce test reports, evaluation records, and rollback criteria for each release
  • Work with platform engineering to ensure test environments match production
  • Hold the release gate until required evidence exists

Benefits

  • Fully remote, results-based environment
  • Bonus and equity package
  • 100% employer paid health insurance including medical, dental, and vision for you and your family
  • Unlimited PTO with manager approval
  • Flexible work environment
  • 14 weeks fully-paid parental leave
  • Optional 401K and FSA
  • Mental health benefits through Tara Mind
  • GLP-1 solutions available through Crux