QA Tester, AI Development
About This Role
The QA Tester is the quality gatekeeper for Insight's AI Development team, responsible for defining and executing test strategies across AI-powered applications. This role goes beyond traditional functional testing — you will validate the reasoning, accuracy, and safety of AI agents and LLM-powered features, while also maintaining robust automation frameworks for the full application stack. You will lead QA efforts across multiple projects and mentor team members on testing best practices for AI applications.
Key Responsibilities
Define and implement test strategies for AI-powered applications, including functional, integration, regression, and AI-specific testing (prompt evaluation, hallucination detection, guardrail validation).
Build and maintain automated test frameworks using Python (Pytest) and UI automation tools (Playwright, Cypress, or Selenium) for React front-ends and API back-ends.
Validate AI model outputs for accuracy, safety, and adherence to expected behaviors across agentic workflows and conversational interfaces.
Integrate automated test suites into CI/CD pipelines to ensure rapid feedback on code changes.
Lead defect management: identify, document, reproduce, and track bugs; work closely with developers to verify fixes.
Collaborate with AI Developers, Full Stack Developers, and DevOps Engineers to ensure quality is embedded throughout the development lifecycle.
Establish QA metrics and reporting to communicate quality status and risk to stakeholders.
Qualifications
Experience: Minimum 3 years of experience as a QA Engineer or SDET, with experience testing complex web applications and API integrations.
Automation: Proficient in Python for writing automated test scripts (Pytest preferred); experience with UI automation tools (Playwright, Cypress, or Selenium).
API Testing: Strong understanding of REST APIs; experience validating API responses and JSON schemas.
AI/ML Testing: Familiarity with testing LLM-powered applications, including non-deterministic output validation. Experience with evaluation frameworks (RAGAS, LangSmith, or similar) is a plus.
Cloud: Working knowledge of Microsoft Azure; ability to navigate cloud logs and debug deployed services.
CI/CD: Experience integrating test suites into CI/CD pipelines (Azure DevOps, GitHub Actions).
Communication: Strong written and verbal English communication skills; ability to articulate risk and quality metrics to stakeholders.
Nice to Have: Experience with performance testing, security testing, or accessibility testing.
The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here .
About Insight
Today, every business is a technology business. Insight Enterprises, Inc. empowers organizations of all sizes with Insight Intelligent Technology Solutions™ and services to maximize the business value of IT. As a Fortune 500-ranked global provider of digital innovation, cloud/data center transformation, connected workforce, and supply chain optimization solutions and services, we help clients successfully manage their IT today while transforming for tomorrow. From IT strategy and design to implementation and management, our 11,000 teammates help clients innovate and optimize their operations to run smarter. Discover more at insight.com
...event marketing, and community engagement ? Our growing team is hiring Customer Service & Event Representatives to support live... ...nonprofit organizations and community-focused partners. This entry-level position is perfect for candidates who enjoy meeting new people...
...support of our community, many women have found new beginnings and a place to call home. The Sophia Way is looking for an Executive Director to join our team. Position Summary The Executive Director plays a pivotal role in the success and sustainability of The...
...Consulate General of Switzerland The Consulate General of Switzerland in Atlanta is offering a full-time (40 hours per week) internship for 12 months, from September 2026 to August 2027. The remuneration for this position is USD 3,200 per month (gross salary). The purpose...
...members to come grow with us! Pay Range: $42,800.00 - $61,500.00 Job Summary We are seeking a motivated and detail-oriented Panel Shop Technicianto join our team. This experienced position is ideal for individuals looking to grow a career in electrical panel assembly...
...Summary: In this role, your focus will be on performing electrical power system studies, electrical equipment selection verification,... ...ensure uniquely complex requirements of a projects electrical engineering aspect are met. #LI-AA1 Major Responsibilities:...