About our crawler

AI Readiness scores a public Shopify storefront on how discoverable and usable it is for AI shopping agents. It reads public pages only — the same pages any shopper or search crawler can already request.

It never signs in, never submits a form, never adds to a cart, and never makes any change to a store.

Every scan is started by a person typing a store URL into our site. There is no discovery crawl and no queue of sites we work through on our own — if we requested your pages, somebody asked us to, usually the merchant or someone evaluating the store.

Results are cached for 24 hours per store, so repeated requests for the same store in that window do not reach you at all.

A scan is hard-capped at 80 requests and usually makes far fewer. That is the entire visit.

We make at most 4 requests at a time and leave at least 200 milliseconds between them, so a scan takes several seconds rather than arriving as a burst.

We retry once, with backoff, and we honor Retry-After. After 5 consecutive refusals we stop requesting your store altogether for the rest of the scan.

If your store rate limits or blocks us, the affected checks are reported as untested. We never record a defensive response as a fault in your store.

Add the following to your robots.txt and we will stop. We read robots.txt before anything else and respect it.

User-agent: AIReadinessBot
Disallow: /

Write to support@pthreemedia.com and we will answer.

If you would rather we never scanned your store and cannot edit your robots.txt, use the opt-out form at /opt-out. It takes effect immediately — there is no review queue.