Quality Engineer Tester

Role Overview

We are seeking a highly motivated Quality Engineering (QE) Consultant with 4–6 years of experience in software testing, automation, and emerging AI technologies. The ideal candidate will have hands-on experience testing AI/GenAI applications, APIs, and web applications, along with strong expertise in Playwright automation and AI evaluation frameworks. This role focuses on ensuring the quality, reliability, safety, and performance of AI-powered solutions by designing comprehensive test strategies, implementing automation frameworks, validating AI model behavior, and establishing evaluation mechanisms for large language model (LLM)-based applications.

Responsibilities

• Design and execute test strategies for AI/GenAI applications, including LLM-powered solutions, AI agents, copilots, and conversational systems.
• Validate AI outputs for accuracy, relevance, groundedness, consistency, hallucination detection, toxicity, and safety compliance.
• Create and maintain prompt test suites and benchmark datasets.
• Perform functional, regression, performance, and reliability testing for AI-enabled applications.
• Define and execute AI evaluation metrics and quality gates.
• Develop and maintain test automation frameworks using Playwright.
• Automate UI, API, and end-to-end business workflows.
• Integrate automated tests into CI/CD pipelines.
• Design and execute API test cases using tools such as Postman, REST Assured, or Playwright.
• Establish AI evaluation frameworks and quality scorecards using techniques like Precision/Recall and Semantic similarity.
• Collaborate with engineering, product, and AI teams to identify quality risks early.

Requirements

• 4–6 years of experience in Quality Engineering, Software Testing, or Test Automation.
• Hands-on experience testing AI/Generative AI applications.
• Strong expertise in Playwright automation.
• Hands-on experience with API testing and automation.
• Experience validating AI/LLM-based applications and AI agents.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
• Ability to commute/relocate to Bangalore.

Skills

• Playwright
• Postman
• REST Assured
• Python
• TypeScript

Benefits

• Paid sick time
• Paid time off