Automation QA Engineer

Skills

About the Role

You will analyze testing requirements and create automated test scenarios, detailed test cases, test data, tools, and environments. You will execute tests, document results, manage defects, analyze outcomes, and maintain test documentation. You will support junior QA engineers and act as a subject matter expert for designated modules. You will use AI tools and OpenAI APIs to accelerate testing, validate LLM-driven applications, secure AI workflows, and monitor AI/ML systems for bias, drift, hallucinations, and performance deviations.

Requirements

• 5+ years of experience developing, executing, and maintaining automated test cases for mobile applications, web applications, and/or APIs
• Professional experience with Appium, Selenium, or Rest-Assured
• Proficiency with Cucumber
• Experience with CI/CD tools such as Jenkins or Bitrise
• Basic understanding of microservices architecture and testing challenges
• Ability to analyze technical requirements, design test strategies, and create test cases
• Experience with AI productivity tools including NotebookLM, Gemini, Cursor AI, and GitHub Copilot
• Knowledge of OpenAI API usage, key management, embeddings, and LLM integration workflows
• Familiarity with MCP server concepts and test automation pipeline integration
• Understanding of AI validation techniques for bias, hallucinations, drift, and robustness

Responsibilities

• Analyze testing requirements and develop comprehensive test scenarios
• Design and create test cases for functional and non-functional requirements
• Prepare and manage test data, tools, and environments
• Execute test cases and scripts and document results
• Log, track, and verify defects
• Collect, organize, and analyze test results and report QA activities
• Recommend solutions for identified issues
• Maintain and update test documentation for new features and regression testing
• Participate in testing discussions and continuous improvement
• Act as a subject matter expert for designated modules
• Guide and support junior QA engineers through onboarding and training
• Use AI tools to accelerate test case design, automation, and exploratory testing
• Apply prompt engineering and RAG techniques to validate LLM-driven applications
• Work with OpenAI keys, LLM models, and MCP server integrations
• Test and monitor AI/ML systems for bias, drift, hallucinations, and performance deviations

Benefits

• Super Flex Time with no core time
• Holidays on Saturdays, Sundays, Japanese national holidays, New Year's break, and company-designated special days
• Annual leave
• Personal leave
• Social insurance
• 401K
• Language learning support
• Translation and interpretation support
• Visa sponsorship
• Relocation support