Intermediate QA Analyst - Contract (6 months)

Role Objective

The QA Analyst will be an integral part of the product development team, ensuring high-quality delivery across modern, AI-driven applications. This role focuses on validating core application features, agent-based workflows, and automation frameworks , alongside traditional manual testing in a fast-paced Agile environment.

The ideal candidate is detail-oriented, proactive, and comfortable working with emerging technologies such as AI/ML systems, prompts, and agent-based workflows , while maintaining strong fundamentals in QA practices.

Specific Responsibilities and Duties

• Perform manual testing of web applications, including UI, functional, exploratory, and regression testing
• Validate AI-driven features , including prompt-based outputs, recommendations, and decision workflows
• Test and verify agent-based systems and integrations , ensuring accuracy, reliability, and edge-case handling
• Create and execute test plans, test cases, and test scenarios with clear coverage of AI behaviors and expected outcomes
• Design, develop, and maintain automated test scripts using Playwright
• Identify and document defects with detailed steps, logs, and supporting evidence
• Collaborate with developers, product managers, and stakeholders to understand requirements and clarify expected AI behavior
• Participate in Agile ceremonies (daily stand-ups, sprint planning, retrospectives, defect triage)
• Validate backend data flows and integrations where applicable
• Continuously improve QA processes, especially around AI testing strategies and automation coverage
• Perform risk analysis for AI-related features (e.g., unexpected outputs, inconsistencies, performance concerns)

Qualifications and Required Skills

Education & Experience

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
• 3+ years of experience in software QA (manual + automation)

Technical Skills

• Strong experience in manual testing (functional, regression, exploratory)
• Hands-on experience with Playwright (preferred) or similar automation frameworks
• Experience testing modern web applications (UI + backend integration)
• Basic understanding of AI/ML concepts , LLMs, or prompt-based systems
• Experience testing AI features, recommendations, or conversational systems is a strong asset
• Familiarity with agent-based workflows or automation tools involving AI is highly desirable
• Experience with API testing (preferred) (Postman or Swagger)
• Working knowledge of SQL and data validation
• Familiarity with CI/CD pipelines and automated test execution
• Experience with Agile methodologies and tools such as Azure DevOps

Analytical & Soft Skills

• Strong problem-solving and debugging skills, especially for non-deterministic AI outputs
• Ability to think critically about edge cases, data variations, and unexpected system behavior
• Excellent communication skills (verbal and written)
• Strong attention to detail and organizational skills
• Ability to work collaboratively across teams in a fast-paced environment
• Curiosity and willingness to learn emerging AI testing practices and tools