- Home
- IT & Software Jobs
- IT & Software Jobs in Abu Dhabi
- Ai Automation Tester
Ai Automation Tester
Description:
We are looking for an experienced AI Automation Tester with hands-on experience in Agentic AI testing to validate AI-powered applications, autonomous agents, and intelligent workflows. The candidate should have experience testing AI agents for accuracy, reliability, decision-making, tool execution, and end-to-end workflow performance.
Experience in the Airline Loyalty domain will be an added advantage.
Key Responsibilities
- Design and execute test cases for Agentic AI applications and AI-driven workflows.
- Validate AI agents' decision-making, reasoning, planning, and task execution capabilities.
- Test multi-agent interactions, orchestration, and communication between AI agents.
- Validate agent interactions with APIs, external tools, databases, and enterprise systems.
- Evaluate LLM responses for accuracy, relevance, consistency, hallucinations, and contextual correctness.
- Perform functional, integration, regression, and end-to-end testing of AI-powered applications.
- Test prompt effectiveness, response quality, and context retention.
- Validate exception handling, fallback mechanisms, and unexpected agent behaviours.
- Develop automated test scripts and frameworks for AI-based applications.
- Identify, document, and track defects, working closely with AI developers and engineering teams.
Mandatory Skills
- Hands-on experience in Agentic AI Testing.
- Experience testing AI agents and LLM-powered applications.
- Understanding of AI agent workflows, tool calling, orchestration, and autonomous task execution.
- Experience with API testing and integration testing.
- Knowledge of prompt engineering and prompt validation.
- Experience evaluating AI responses for accuracy, hallucinations, and reliability.
- Automation testing experience using Python or other relevant automation tools.
Good-to-Have Skills
- Experience in the Airline Loyalty domain.
- Knowledge of airline loyalty programmes, including:
- Miles earning and redemption.
- Membership and tier management.
- Loyalty points calculation.
- Rewards and benefits management.
- Experience testing AI-driven customer service or recommendation systems.
Apply Now
You'll sign in or register, then come back to this job.
No CV yet? Make one free and apply.
| Organization | HTC Global Services |
| Industry | IT / Telecom / Software Jobs |
| Occupational Category | AI Automation Tester |
| Job Location | Abu Dhabi, UAE |
| Shift Type | Morning |
| Job Type | Full Time |
| Gender | No Preference |
| Career Level | Intermediate |
| Experience | 2 Years |
| Posted at | 2026-11-19 7:25 pm |
| Expires on | 2027-02-17 |