Agent readiness audit

How a test run works: AI agents on real store tasks.

Named AI agents try key tasks on your public pages. Each run keeps a step log, step screenshots and the checks it was held to.

northwind-outdoor.example/
Step 1 / 6
0.0 s

Illustrative run on an example store. Step screenshots, not video.

A scoped audit answers operational questions.

The audit starts from a customer goal and ends at a verified state, not a checklist count.

  1. Can the agent find the current facts it needs?

  2. Can it interpret prices, policies, inventory and controls?

  3. Can it complete the allowed action without losing state?

  4. Can it recover from validation, expired sessions and unavailable inventory?

Every conclusion stays connected to the run.

This illustrative chain shows how an observed problem becomes an engineering action.

Pick a link in the chain

Scenario

Compare delivery options on a product page.

Review the session, not only the final label.

Timing, attempts and layout stability explain how reliable a success really was.

  • 6Step screenshotsFollow the agent path step by step, with masked screenshots and the checks each step was held to. There is no video.
  • 18.4 sCompletion timeMeasure wall-clock duration and time spent waiting for navigation, rendering and recovery.
  • 2AttemptsEach test run is one attempt by one agent. Repeated attempts show whether a success holds.
  • 0.18Cumulative Layout ShiftMeasure layout shifts on each page the agent visits. It is a lab measurement in our browser, not field data.

Illustrative run

The audit package is built for action.

Results are useful to leadership, engineering, QA, product and security without hiding uncertainty.

  1. 1A plain verdict limited to the tasks we tested
  2. 2Results per task for each agent that ran
  3. 3Critical and High fixes with the step that failed
  4. 4Step screenshots and step logs
  5. 5Remediation backlog with acceptance criteria

Boundaries are agreed before the first run.

AI agents stop before login, cart, checkout, payment, booking or any form that sends data. Full journeys on an approved staging site are coming later.

  • Login
  • Cart
  • Checkout
  • Payment
  • Booking
  • Forms that send data

What the audit does not claim

  • A single agent result does not represent every agent product.
  • A detected technology is not proof that a business task works.
  • A passed task is not a guarantee of future model behavior.

A partner audit starts small and stays reproducible.

  1. 1Scope the journeyChoose one to three business-critical tasks, environments and stop gates.
  2. 2Run and reviewRun each task, check the outcome against the evidence and have Aiscovery review it.
  3. 3Prioritize and retestShip selected fixes, rerun the same contract and compare the evidence.

Audit questions

Can you test authenticated workflows?

Not yet. Tests of logged-in pages are coming later. Today site checks read public pages only.

Do you record the agent session?

Yes, as evidence: each run keeps a step log and step screenshots with sensitive data hidden. We don't record video.

How many times is a scenario run?

Each test run is one attempt by one agent. Run a key task again, or with another agent, to see whether a success holds.

Bring one difficult journey into focus.

Leave three details. We pick the task with you, run it on your store and walk you through the evidence.

Have a real workflow to test now? Apply as a launch partner

We only use this to arrange your demo. Privacy notice