QA Engineer / Software Tester – Agentic AI

Role Overview

We are looking for a QA Engineer / Software Tester with knowledge of Generative AI and Agentic AI to join our team and help test an Agentic AI framework.

Responsibilities

• Test Agentic AI applications and AI-driven workflows.
• Validate complete agent workflows: User Request → Planning → Tool Selection → Execution → Final Response.
• Test LLM-based applications for accuracy, relevance, consistency, and hallucinations.
• Validate tool/function calling, including API parameters, responses, failures, and retries.
• Test multi-agent workflows and communication between agents.
• Test RAG (Retrieval-Augmented Generation) workflows and knowledge retrieval.
• Validate agent memory and context handling.
• Perform API testing using Postman or similar tools.
• Perform database testing and backend data validation using MySQL.
• Write and execute complex SQL queries to validate application and AI-agent data.
• Perform functional, integration, regression, negative, and edge-case testing.
• Perform basic prompt injection and AI security/guardrail testing.
• Analyze agent execution logs and identify the root cause of failures.
• Create and maintain test cases, test scenarios, bug reports, and QA documentation.

Requirements

• Strong knowledge of Software Testing / QA fundamentals.
• Experience with Manual Testing and API Testing.
• Strong knowledge of MySQL and database testing is mandatory.
• Strong SQL skills, including JOINs, subqueries, GROUP BY, and aggregate functions.
• Good understanding of REST APIs, JSON, and Postman.
• Understanding of Generative AI, LLMs, prompts, tokens, context, and hallucinations.
• Knowledge of Agentic AI concepts, RAG, and vector databases.
• Ability to design test cases for non-deterministic AI outputs.

Skills

• MySQL
• Python
• Postman
• SQL
• Generative AI

Nice to Have

• Python knowledge and test automation experience.
• Selenium, Playwright, or PyTest.
• Experience with LangChain, LangGraph, Semantic Kernel, AutoGen, or CrewAI.
• Experience with Azure, AWS, or GCP.
• Git, CI/CD, and Docker knowledge.