AI Virtual Assistant Tester
Systems Limited - Middle East & Africa (Techvista)
Dubai, United Arab Emirates · Full Time
Be the first to apply
- Experience
- 3–8 yrs
- Salary
- —
- Openings
- 1
- Posted
- 3 weeks ago
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Job Overview
As organizations increasingly implement Generative AI, Large Language Models (LLMs), and AI-powered Virtual Assistants, the need for quality assurance in these innovative technologies becomes paramount. We are seeking a dedicated AI Virtual Assistant Tester to ensure the reliability, correctness, and excellence of conversational AI solutions before deployment.
Key Responsibilities
- Conduct comprehensive testing of Conversational AI and Virtual Assistant platforms.
- Validate responses from LLMs and detect hallucinations in AI outputs.
- Evaluate prompts and their engineering to optimize AI interactions.
- Perform validation for Retrieval-Augmented Generation (RAG) techniques.
- Test Natural Language Understanding (NLU) and Natural Language Processing (NLP) by verifying intent and entity recognition.
- Assess context handling and memory functionalities within AI systems.
- Engage in API, integration, and regression testing to ensure smooth system operations.
- Test for performance, security, and user experience factors.
- Review AI ethics, address bias issues, and uphold responsible AI principles during validation.
Required Technical Skills
- Expertise in both manual and automated testing methodologies.
- Proficient in API testing tools such as Postman and Swagger.
- Working knowledge of SQL, REST APIs, and JSON/XML data formats.
- Experience with automation frameworks like Selenium, Playwright, Cypress, or Appium is preferred.
- Programming skills in Python or Java are advantageous.
- Familiarity with issue and project management tools, including JIRA and Azure DevOps.
Experience and Qualifications
- A minimum of 3 years up to 8+ years in Quality Assurance roles.
- Proven experience in testing AI chatbots, Virtual Assistants, or Conversational AI platforms.
- Strong understanding of Generative AI, LLMs, prompt engineering, and Retrieval-Augmented Generation (RAG) concepts.
- Experience working within Agile or Scrum team environments.
Additional Preferred Expertise
- Familiarity with Microsoft Copilot.
- Exposure to OpenAI or Azure OpenAI services.
- Knowledge of Google Vertex AI and Amazon Bedrock platforms.
- Experience with speech recognition technologies and voice assistant applications.
- Understanding of AI governance frameworks and responsible AI practices.
About the Role
If you are passionate about enhancing the future of AI by ensuring intelligent systems perform accurately, securely, and with a strong focus on customer satisfaction, this position offers an exciting opportunity to contribute significantly to the field.