What do AI agents get from your site?
The probe fetches your home page and up to three other pages as a normal browser and as 9 named crawlers and AI agents, then shows what each one got.
How it works
- Each request uses the agent's documented User-Agent with
PosternaProbe/0.1added, and is signed with Posterna's own key, so your logs show it was us. - It reads your robots.txt first. Pages that robots.txt closes to
PosternaProbeare not fetched, and the report says so. - Two requests at a time, with a pause between them: about 40 requests in all.
- It keeps status codes, sizes and fingerprints (SHA-256), never page contents. Results are cached for an hour, and anyone with the report link can see it.
- The requests come from Posterna's servers, not from the agents. Sites that check agents by IP address or signature will rightly treat them as unverified. What we store.