QlarifyLabs
← AI in Testing
Doing the testingExperimental

Autonomous exploration agents

An agent drives the application through its UI or API without a script, choosing its own actions, noticing oddities and reporting back with candidate issues.

How it works

The agent gets a charter and access to a running test environment. It then loops: observe the current state, choose an action, act, record. It watches for errors and crashes, console errors, broken links, data that disagrees across screens, and states it cannot leave. It returns a session log, a map of where it went, and candidate issues with reproduction steps. Each candidate has to be replayed to confirm it.

A charterand a test environmentObserveChooseActRecordWatches for crashes, console errors,broken links, data that disagrees,and states it can’t leave.Returnssession logmap of where it wentcandidate issues, with stepsReplay each oneto confirm it’s realActivity isn’t coverage: it noticescrashes far more than subtle wrongness.
The agent loops until its charter or budget runs out. Nothing it reports counts until it has been replayed and confirmed.

When to use it

Broad smoke exploration of a new build in a safe environment; reaching corners scripted tests don't; and mapping a product for test planning.

Limitations

Runs are nondeterministic, so coverage is neither repeatable nor comparable between runs. Agents notice crashes far more reliably than subtle wrongness, because they don't know what should happen. False alarms and invented repro steps can make triage cost more than the run saved. Its actions are real: with live integrations it can send email or delete data, so it needs a sandbox and limits. It's easy to mistake activity for coverage.

Watch for

A clean report from a run in which the agent was logged out early and spent the rest of its time on the login page. Check the map of where the agent actually went before treating a quiet run as good news.

What you still own

The environment's boundaries and permissions, the charter, and confirming every reported issue before it becomes a bug.

Related evals

Cite this

Qlarify Labs. (2026). Autonomous exploration agents. Retrieved from https://labs.qlarify.fi/ai-in-testing/autonomous-exploration-agents