Sign InSign Up
Skip to content
← Back to job listings

Senior/Staff QA Engineer – Agentic AI Platform

Ontrac Solutions · Chicago, IL

RemoteExternal listingcontract20 days ago

About The Role

Overview

We are seeking a highly skilled and experienced

Senior/Staff QA Engineer

to support a critical customer engagement. This role is ideal for a detail-oriented tester who thrives owning quality end-to-end — someone equally comfortable writing precise manual test cases and building automated coverage for a fast-moving agentic AI product.

The successful candidate will work closely with the

Delivery Lead/Solutions Architect

and customer engineering stakeholders to ensure product quality from initial test planning through final release.

Required Credentials

  • 5+ years
  • of professional QA experience, with at least
  • 2+ years
  • at a senior or staff level.
  • Demonstrated experience testing production software through a full

Application Development Lifecycle (ADLC)

.

Required Qualifications

ADLC Expertise

Strong understanding of the Application Development Lifecycle — from requirements through release and support.

UI/UX Acumen

Solid UI/UX understanding, with the ability to evaluate usability and flag design/interaction issues, not just functional bugs.

AI Agent Testing

Hands-on experience testing AI Agent use cases — including conversational flows, agent decision-making, tool/function calling, and edge-case or failure-mode behavior.

Automation Frameworks

Proven experience with automated testing frameworks and building maintainable, scalable test suites.

Infrastructure Management

  • Ability to stand up and manage a
  • Playwright cluster
  • to run automated end-to-end (E2E) testing against a live agent platform.

Autonomy

Ability to independently define clear, well-structured test cases from ambiguous or evolving product requirements.

Lifecycle Ownership

Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, and sign-off.

Required Technical Stack Experience

(Suggested Completion)

Automation Frameworks

Deep expertise with

Playwright

(including cluster management and parallel execution).

Languages

Proficiency in

JavaScript / TypeScript

or

Python

for writing automation scripts.

AI/LLM Tools

Familiarity with testing LLM outputs, prompt evaluation frameworks, or conversational AI testing tools.

CI/CD & DevOps

Experience integrating automated test suites into pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization.

Defect Tracking & Tools

  • Proficiency with Git, Jira, and modern test management tools.
  • __________________________________
  • Ontrac Solutions has partnered with

PinpointVerify

to help genuine applicants rise above the noise. Today, qualified candidates are too often overshadowed by fake and fraudulent applications. PinpointVerify gives our recruiters confidence that you are exactly who you say you are — and gives you a

portable verification credential

you can share with any employer.

Applicants who complete verification are

prioritized over non-verified candidates

with comparable experience.

And if you're hired, Ontrac reimburses the full cost of your verification.

Get verified →

<https://pinpointverify.com/ontrac>

This is an external listing. JobSpring does not represent or verify the employer. Report this listing