Ai Automation Tester

 

Description:

We are looking for an experienced AI Automation Tester with hands-on experience in Agentic AI testing to validate AI-powered applications, autonomous agents, and intelligent workflows. The candidate should have experience testing AI agents for accuracy, reliability, decision-making, tool execution, and end-to-end workflow performance.

Experience in the Airline Loyalty domain will be an added advantage.

Key Responsibilities

  • Design and execute test cases for Agentic AI applications and AI-driven workflows.
  • Validate AI agents' decision-making, reasoning, planning, and task execution capabilities.
  • Test multi-agent interactions, orchestration, and communication between AI agents.
  • Validate agent interactions with APIs, external tools, databases, and enterprise systems.
  • Evaluate LLM responses for accuracy, relevance, consistency, hallucinations, and contextual correctness.
  • Perform functional, integration, regression, and end-to-end testing of AI-powered applications.
  • Test prompt effectiveness, response quality, and context retention.
  • Validate exception handling, fallback mechanisms, and unexpected agent behaviours.
  • Develop automated test scripts and frameworks for AI-based applications.
  • Identify, document, and track defects, working closely with AI developers and engineering teams.

Mandatory Skills

  • Hands-on experience in Agentic AI Testing.
  • Experience testing AI agents and LLM-powered applications.
  • Understanding of AI agent workflows, tool calling, orchestration, and autonomous task execution.
  • Experience with API testing and integration testing.
  • Knowledge of prompt engineering and prompt validation.
  • Experience evaluating AI responses for accuracy, hallucinations, and reliability.
  • Automation testing experience using Python or other relevant automation tools.

Good-to-Have Skills

  • Experience in the Airline Loyalty domain.
  • Knowledge of airline loyalty programmes, including:
  • Miles earning and redemption.
  • Membership and tier management.
  • Loyalty points calculation.
  • Rewards and benefits management.
  • Experience testing AI-driven customer service or recommendation systems.

Apply Now
You'll sign in or register, then come back to this job.
No CV yet? Make one free and apply.
Organization HTC Global Services
Industry IT / Telecom / Software Jobs
Occupational Category AI Automation Tester
Job Location Abu Dhabi, UAE
Shift Type Morning
Job Type Full Time
Gender No Preference
Career Level Intermediate
Experience 2 Years
Posted at 2026-11-19 7:25 pm
Expires on 2027-02-17