LLM QA Engineer– AI Testing&Validation (Remote), Job

We are seeking an AI Tester to support the development and quality validation of an upcoming Large Language Model (LLM) project. This role focuses on using AI tools such as ChatGPT and similar platforms to design test scenarios, generate test cases, validate outputs, and improve overall model quality during the development lifecycle.

The ideal candidate should be comfortable experimenting with AI tools, evaluating generated outputs, identifying gaps or inconsistencies, and contributing to the creation of reliable AI-driven solutions.

Key Responsibilities

Use ChatGPT and other AI/LLM tools to generate and refine test cases, prompts, and validation scenarios. Design functional, negative, edge-case, and behavioral test scenarios for LLM-based applications. Validate model outputs for accuracy, consistency, logic, formatting, and business relevance. Identify hallucinations, incorrect responses, bias, or incomplete outputs from AI systems.Assist in prompt testing, response evaluation, and quality benchmarking. Create datasets and expected result validations for AI output testing. Collaborate with developers, AI engineers, and product teams during the LLM development phase. Document observations, defects, test findings, and improvement recommendations.Support continuous enhancement of AI testing processes and evaluation frameworks.

Required Skills

Strong analytical and critical thinking skills. Familiarity with ChatGPT or other generative AI tools. Understanding of software testing concepts and QA processes. Ability to evaluate and validate AI-generated outputs logically and contextually. Good documentation and communication skills. Attention to detail and curiosity to explore edge cases and AI behavior.

Preferred Qualifications

Bachelor’s degree in Computer Science, IT, Engineering, Data Science, or related field. Experience in QA/testing, prompt engineering, or AI-assisted workflows is an advantage. Basic understanding of APIs, automation testing, or scripting is preferred. Exposure to NLP, Generative AI, or LLM concepts isa plus.

Job Location- Remote

#J-18808-Ljbffr