Software Quality Engineer

Skills

About the Role

You will define quality strategies and test plans for AI agents and LLM-powered applications. You will build automation frameworks, translate AI features into test cases, integrate checks into CI/CD, manage defects and test data, monitor production performance, and champion quality practices.

Requirements

• 5+ years of software quality assurance or engineering experience
• 5+ years of GitHub Actions experience
• Proficiency with Python or TypeScript for test automation
• Experience with Playwright
• Understanding of AI and machine-learning concepts, model evaluation metrics, data pipelines, and generative AI testing
• Experience with AWS, Azure, or GCP
• Experience with Docker, Kubernetes, and CI/CD
• Experience designing, developing, or integrating agentic AI systems, AI skills, or MCP

Responsibilities

• Define and implement quality assurance strategies and test plans
• Design and develop automated test frameworks
• Translate AI features and model behaviors into test cases and validation criteria
• Integrate automated checks into CI/CD pipelines
• Identify, document, prioritize, and track software defects
• Perform root-cause analysis and provide feedback to development teams
• Monitor production systems and AI model performance
• Manage test data strategies and mock services
• Champion quality best practices across engineering teams
• Analyze customer feedback and debug logs throughout the defect lifecycle

Benefits

• Generous PTO and company holidays
• Comprehensive medical and dental insurance
• 16 weeks of paid parental leave
• Fertility and family planning support
• Early-detection cancer testing
• Pension scheme with company contribution
• Wellness stipend
• Learning and development stipend
• Company-wide and team off-sites
• Company stock options