Skip to main content
Colter Test

What happens when
agents try to buy?

Colter sends 10 AI agents through real shopping journeys on your store. They browse, inspect products, add to cart, and attempt checkout so you can see exactly where they succeed and where they get stuck.

Start a testView documentation
colter test
$colter test https://my-store.com --json
Pre-check: discovery surfaces detected
Launching 10 AI agent journeys...
DISCOVERY ✓ Product data and agent surfaces found
PRODUCT ✓ 8 personas reached product detail
CART ✓ 6 personas proved cart integrity
CHECKOUT ✗ 4 personas hit login before handoff
BROWSER ✓ 5 storefront screenshots captured
Score: 82/100 — blockers isolated to checkout and login
Screenshots saved to ./colter-test-screenshots/
How it works

One run. Two layers of evidence.

Live agent journeys

10 AI agents

Ten AI agents make real storefront requests across discovery, product evaluation, returns, edge cases, security, mobile, and checkout handoff.

  • CoverageDiscovery, product detail, cart integrity, returns, security, mobile, and checkout readiness
  • ModelsGPT, Claude, and Gemini — cross-model evidence from the production stack
  • OutputPer-persona scores, journey reports, blockers, and remediation recommendations

Browser evidence

Included

When your store exposes browser agent tools, the same run adds a live Chrome replay with screenshots and tool traces so you can verify the storefront works the way it should.

  • EngineCloudflare Browser Rendering with live storefront navigation
  • RequiresBrowser agent tools on your store (Fix can generate them)
  • OutputJourney screenshots, tool invocation logs, and setup guidance when tools are missing
Journey stages

Five stages of an agent shopping flow

Each stage maps to a real step in an AI agent's purchase flow.

JOURNEY FUNNEL

18% conversion
Discover100%
22% left· Intent mismatch
Browse78%
33% left· Missing product schema
Evaluate45%
12% left· Variant selector broken
Cart33%
15% left· Checkout requires login
Checkout18%

18% of agents complete a purchase. The biggest drop happens at Browse → Evaluate — most agents can't parse product schema.

For agents and developers

Works from CLI, API, and MCP

AI agents discover and invoke tools programmatically. Developers get the same access from the command line.

CLI
colter test
$colter test https://my-store.com
$colter test https://my-store.com --json
$colter test https://my-store.com --personas claude_shopper,the_returner
$colter test https://my-store.com --json | jq .summary.overall_score
REST API
REST APIbash
# AI agent test (live storefront evidence)
curl -X POST https://agenticcom.ai/api/v1/test \
  -H "Authorization: Bearer col_..." \
  -d '{"url": "https://my-store.com"}'
 
# Results include: personas[], summary,
# journey_reports, remediations[],
# per-model scores, total_cost_usd

Install: npx -y @getcolter/cli · MCP: npx -y @getcolter/cli mcp --admin-tools

FAQ

Common questions

What happens during a test?

10 AI agents attempt real shopping journeys on your store across Claude, GPT, and Gemini. Each one tests a different path: discovery, product detail, cart integrity, checkout readiness, returns, security, mobile, and edge cases.

Will the test affect my store?

No purchases are completed. Personas browse, add to cart, and attempt checkout but stop before payment. Read-only except for cart actions.

How is this different from Check?

Check scans your infrastructure. Test shows what happens when agents actually try to use it. Check tells you what is missing; Test shows you where the live journey breaks.

What do I get in the report?

Per-persona scores, journey narratives, remediation recommendations, and a PDF export. You see exactly where each agent succeeded or got stuck.

Does Test include browser testing?

Yes. When your store exposes browser agent tools, the same run adds a live browser replay with screenshots and tool traces for verification.

Next step

Monitor what happens in production.

Test validates your store works. Lens watches real agent traffic — who visits, what they try, where they drop off.

Learn about Lens