Skip to main content

Technical Signal Score

How the legacy Check score summarizes detected public technical signals. It does not measure placement, recommendation, purchase behavior, conversion, or revenue.

TL;DR: The legacy Check score summarizes public protocol, page, content, and security signals from 0 to 100. It is a technical proxy, not a named-agent or commercial outcome. Improve the underlying evidence, not the number alone.

Formula

composite = round(
  transaction * 0.30 +
  discovery * 0.25 +
  ecosystem * 0.20 +
  content_quality * 0.15 +
  security * 0.10
)

Dimensions

DimensionWeightHigh-value signals
Transaction30%UCP, ACP, checkout capabilities, fast protocol endpoints, compatible PSP, declared agent-payment rails
Discovery25%JSON-LD, sitemap, llms.txt, ai-plugin.json, robots posture, Open Graph
Ecosystem20%UCP, ACP, MCP, and WebMCP endpoint or declaration evidence
Content Quality15%Complete product schema, price, availability, images, SSR
Security10%HTTPS, HSTS, CSP, XFO, X-Content-Type-Options, rate limiting

Score Bands

ScoreMeaning
75-100More of the weighted public signals were present
60-74Several weighted public signals were present
40-59Many weighted public signals were absent or incomplete
0-39Most weighted public signals were absent or incomplete

Agentic Commerce Level

For compatibility, Colter also emits a legacy agentic_level and label. These are technical-progression labels, not proof of what any named agent can do:

LevelLabelMeaning
1Web FormsBasic site presence
2Descriptive SearchPublic catalog-description signals are present
3PersistenceStronger agent identity and handoff support
4DelegationDelegated-commerce capability declarations are present
4.9 maxProgress toward Level 5Level 5 behavior is not directly measurable today

Fix Tiers

Every fix Colter surfaces is classified by tier. The tier controls how the fix appears in the report and how its absence affects your score.

TierAbsenceLabel in reportWhen used
RequiredCosts you score and is flagged as a "Gap"Gap: prefixCore evidence expected by the legacy UCP/ACP scoring model
RecommendedCosts you score and is flagged as an "Opportunity"Opportunity: prefixReal operational value, but your current stack may already cover it via another vendor
BonusNever costs score; never shown as a fixSurfaced in the "Leading edge" commentaryEmerging protocols or leading-edge rails — credit if present, never penalized if absent

The score accumulation respects tier: Required items must be present to hit full dimension credit; Recommended items contribute when present but never subtract; Bonus items only add.

Highest-Impact Fixes

FixTypical effectTier
Add UCPBig transaction and ecosystem liftRequired
Add ACPBig transaction and ecosystem liftRequired
Add complete Product JSON-LDDiscovery and content quality liftRequired
Add llms.txtDiscovery and ecosystem liftRecommended
Add security headersSecurity liftRecommended
Declare UCP catalog search and complete structured identifiersTechnical transaction-signal liftRecommended
Declare agent-payment readiness (x402, AP2, MPP, TAP, Google Pay, card networks, or compatible PSP handlers)Small transaction lift and payment-trust commentaryRecommended

Shopify Storefront Catalog (UCP migration)

Shopify opened UCP with Shopify Catalog as the default Shopify-native readiness path. Colter treats Shopify Catalog / Agentic Storefronts as platform-provided coverage when a Shopify store does not expose merchant-specific public UCP evidence, while still distinguishing public endpoint evidence from Shopify-native baseline coverage.

Shopify migrated the Storefront Catalog MCP to UCP at /api/ucp/mcp with new tool names (search_catalog, lookup_catalog, get_product). Legacy Storefront MCP tool names are being deprecated.

  • Before 2026-06-15: stores on legacy-only tool names get partial credit and a Recommended-tier fix prompting migration.
  • On or after 2026-06-15: legacy-only is scored as a Required-tier Gap. Migrate to the new endpoint before that date.

Current UCP Extensions

Colter detects current UCP extension declarations including fulfillment, buyer consent, AP2 mandate, and loyalty. These are surfaced as report evidence so merchants can see whether the manifest is tracking the latest UCP surface area. They do not change score weight until the public scoring model is recalibrated against live adoption data.

Payment And Trust Rails

Payment and trust rails are scored conservatively. Colter gives recommended/bonus credit when a UCP manifest or related commerce surface declares recognized payment handlers such as Stripe, Visa, Mastercard, Amex, Adyen, Braintree, Google Pay, PayPal, x402, AP2, MPP, or TAP.

These signals do not replace UCP/ACP checkout coverage. They help distinguish stores that expose live product, stock, cart, checkout, payment-policy, and settlement primitives from stores that only publish catalog metadata.

How To Use This Page

  • Use Check to see current scores.
  • Use Fix to get ranked improvements.
  • Use Verify when you need conformance evidence.

Next Steps