Back to all roles

Senior /Lead QA Automation Engineer (AI)

Remote-first Full-time Now hiring

Job Description: Senior QA Automation Engineer Project: Neio Project – AI Product Suite Experience: 6-8 years Senior QA Responsibilities Coordinate QA activities across all Neio Project products. Own QA planning, work allocation, test execution tracking, and status reporting. Guide the 3–5 years QA resources on test coverage, automation standards, and defect quality. Review test cases, automation scripts, API test coverage, and execution results. Act as the primary QA point of contact for product, development, and business teams. Ensure timely QA sign-off inputs for releases. Drive automation framework improvements and QA process consistency. Track QA metrics such as test execution progress, defect status, automation coverage, and regression results. Identify testing risks early and escalate blockers to stakeholders. Good to Have Skills Experience testing AI/ML-based applications, chatbots, RAG platforms, LLM-based tools, or document processing systems. Knowledge of chatbot testing, prompt validation, AI response quality checks, hallucination checks, and fallback response validation. Experience with OCR, document extraction, document synthesis, summarization, or NLP-based products. Experience with database validation using SQL. Exposure to performance testing tools such as JMeter or k6. Knowledge of cloud platforms such as AWS, Azure, or GCP. Experience with accessibility, security, or compliance testing. Preferred Tools and Technologies Area Tools / Technologies UI Automation Selenium, Playwright API Manual Testing Postman API Automation Rest Assured Programming Java, JavaScript, TypeScript, Python Test Management Jira, Azure DevOps, TestRail CI/CD Jenkins, GitHub Actions, GitLab CI, Azure DevOps Version Control Git Build Tools Maven, Gradle, npm Database SQL Reporting Allure, Extent Reports, HTML Reports Candidate Profile The ideal candidate should be a hands-on QA automation professional with strong experience in both UI and API testing. The candidate should be able to understand business requirements, create effective test scenarios, perform functional testing, and automate stable regression flows using Selenium or Playwright. The candidate should have practical experience in API validation using Postman and API automation using Rest Assured with a framework-based approach. They should be comfortable working in an Agile environment, collaborating with developers, product owners, business stakeholders, and AI teams. Since the Neio Project includes AI-driven products such as Neio AI Chat Bot, RAG Platform, document extraction, document synthesis, and generated letter workflows, the candidate should be open to validating AI outputs for accuracy, consistency, relevance, and business correctness. For the senior QA profile, the candidate should additionally have the ability to coordinate work across multiple products, guide junior and mid-level QA resources, review QA deliverables, track progress, and represent QA status to stakeholders. Apply To This Job

More remote roles

Senior Evidence and Access Strategy Manager - Ion DACH

Remote-first Full-time

Full Stack Engineer (Python and React)

Remote-first Full-time

Full Stack Engineer (Python and React)

Remote-first Full-time

Full Stack Engineer (Python and React)

Remote-first Full-time

Full Stack Engineer (Python and React)

Remote-first Full-time

AWS DevOps Engineer

Remote-first Full-time

AWS DevOps Engineer

Remote-first Full-time

Senior / Principal Software Development Engineer

Remote-first Full-time

AWS DevOps Engineer

Remote-first Full-time

General Accountant – IFRS

Remote-first Full-time

Sales Consultant – Insurance Services

Remote-first Full-time

Experienced Part-Time Data Entry Specialist – Remote Financial Analysis and Reporting

Remote-first Full-time

Experienced Online Live Chat Support Agent – Remote Part-Time Opportunity to Kickstart Your Career

Remote-first Full-time

Python/R Programmer (Remote)

Remote-first Full-time

Experienced Full Stack Data Entry Specialist – Remote Customer Support

Remote-first Full-time

Experienced Customer Support Coordinator - Data Entry Specialist at arenaflex

Remote-first Full-time

Corporate Chef - National Accounts (REMOTE) Corporate Chef - National Accounts (REMOTE)

Remote-first Full-time

Experienced Virtual Customer Support Representative - Entry Level - arenaflex

Remote-first Full-time

Experienced Live Chat Support Specialist - Remote Opportunity with arenaflex

Remote-first Full-time

Part-Time Remote Data Entry Specialist – Flexible Home-Based Position at arenaflex | Earn $25/Hour | Data Accuracy & Operations Excellence

Remote-first Full-time