QA Automation Engineer - AI & LLM
QA & Automation Engineer
Locations: Southfield, MI; Princeton, NJ; Santa Clara, CA; Dardenne Prairie, MO; Austin, TX
Work Model: Hybrid (2 days/week in-office)
Contract Opportunity
We are looking for experienced QA & Automation Engineers to join our team on a contract basis. You will be instrumental in developing robust test suites and automation frameworks for our multi-agent and AI-powered systems.
Responsibilities:
- Develop AI-aligned test suites for multi-agent workflows, cross-cloud integrations, and APIs.
- Collaborate with Test Agents to auto-generate and optimize test coverage.
- Automate regression and reliability tests for features driven by Large Language Models (LLMs).
- Perform testing on AI/LLM systems, addressing challenges such as non-determinism, flakiness, and hallucinations.
Requirements:
- Proven experience with test automation in AI/LLM systems.
- Proficiency in API and End-to-End (E2E) testing using frameworks like Playwright, Cypress, and Pytest.
- Familiarity with agent reliability evaluation frameworks.
- Strong understanding of automation for complex, integrated systems.
Preferred Qualifications:
- Experience with automated defect classification.
- Knowledge of testing and evaluating Machine Learning (ML) models.
Apply Now:
If you have a strong background in QA and automation, with a specific interest in the challenges of testing AI and LLM systems, we encourage you to apply. Send your updated resume.
Recommended Jobs
Japanese Restaurant Server
Job Description Job Description Overview: We are seeking a highly motivated and attentive Server to join our team. As a Server at our dining restaurant, you will play a crucial role in providi…
Full Time Pediatrics Job Desert Hot Springs, CA
DAP-29 Pediatrician for So Cal’s favorite Spa and Resort communities, Desert Hot Springs a Suburb of Palm Springs, Famous for its Healing Hot Springs and Health Spas. Local area offers Five Star…
Accounting Manager x 140K - 165K + bonus x San Gabriel / flex POST NUMBER: 435990
Accounting Manager – Inventory – COGS – Internal Controls – GAAP – Retail – Standard Costs – Gross Margin – Cycle Count – Excess – Obsolete – Advanced Excel Are you an Accounting Manager with strong…
Lead Milieu Therapist
Responsibilities We are currently offering a $5,000 sign-on bonus for our full time Therapists! Fremont Hospital is a fully accredited, 148-bed private inpatient psychiatric hospital provi…
Full Time Family Practice Job Sacramento, CA
Enterprise Medical is scheduling Family Medicine interviews for a group practice that has an honored history of serving the health care needs of the people of Colusa, CA, and surrounding areas. …
Licensed Insurance Agent
Leads & Calls: Inbound branded live calls, exclusive leads Pay: Advances paid twice weekly, earned commission paid once weekly, multiple bonuses, exotic vacations Growth: You choose to work …
Temporary Associate
Since its launch in 1993 with a collection of six essential handbags, Kate Spade New York has always been colorful, bold, and optimistic. Today, it is a global lifestyle brand that designs extraordin…
Manager, Robotics Software
About Us Saildrone is a defense company delivering maritime intelligence, surveillance, and reconnaissance products to military, homeland security, and commercial customers. Saildrone unmanned sur…
Regional Vice President, New Business (West)
Description About Us: Our mission is to elevate leading brands through unforgettable digital connections with their customers. Sitecore delivers a composable digital experience platform that emp…
Before School Program Manager
Job Title: Before School Program Manager Are you passionate about giving back to your community and serving the youth? Who We Are: In 1922, Woodcraft Rangers opened its doors in Los Angeles …