22% of Network Traffic Looks AI. AI Referrals Are Still Zero.
Robauto Team · Published · Last updated
Live Robauto pulse: 22.02% of 90-day page views are AI-classified, but ai_referral visits are still 0. Crawlers ≠ referrals — and readiness median sits at 20.
22.02% of Robauto network page views over the last 90 days look like AI. Measured AI referrals are still exactly zero. That is the gap brands miss when they celebrate crawler hits: visits and crawlers are not the same as referrals that send humans (or shopping agents) to your site.
The live pulse, September 29, 2026
From Robauto AI Search Data (network aggregates, cookie-free pixel):
| Metric | Value | Source |
|---|---|---|
| Total page views (90d) | 1,305,282 | AI Search Data |
| AI-classified views (90d) | 287,458 | AI Search Data |
| AI traffic share | 22.02% | AI Search Data |
| ai_referral visits | 0 (0%) | AI Search Data |
| Agent Readiness Index | median 20 / max 75 (79 scored, 20 blocked of 99 attempted) | Agent Readiness Index |
Of those 287,458 classified non-human visits, Robauto’s taxonomy splits the traffic so classic SEO crawlers never inflate the AI-search number:
| Class | Visits | Share | Counts as AI search? | Examples |
|---|---|---|---|---|
llm_crawler |
154,577 | 53.8% | Yes | Meta AI, grok_bot, Copilot, Claude, ChatGPT, Grok/xAI, Gemini, Perplexity, DeepSeek |
ai_referral |
0 | 0% | Yes | — |
search_bot |
97,794 | 34% | No (classic crawlers) | AhrefsBot, SemrushBot, Baiduspider, Amazonbot, Applebot |
other_bot |
34,148 | 11.9% | No | Meta External Agent, HubSpot, DuckDuckBot, CCBot |
headless |
939 | 0.3% | No (automation) | screenshot services |
API note, unchanged this morning: only llm_crawler + ai_referral are AI search; search_bot and headless are classic crawlers and automation.
What ai_referral actually means
llm_crawler is a bot reading your pages to build answers, indexes, or training corpora — Meta AI alone accounts for about 32.1% of classified visits this window (92,317). That is discovery work. It does not put a shopper on your product page.
ai_referral is the other half of AI search: a real referral when someone (or an agent acting for them) arrives from an AI answer surface with a referrer Robauto can attribute. Across the whole network right now that counter is 0. Brands that only get crawled still see zero AI-attributed arrivals — the crawl log grows while the referral column stays blank.
Crawl volume ≠ agent readiness
The public leaderboard’s #1 site by agent visits this week is marketontology.com (7,922 agent visits in 7 days) — and a fresh Agent Scan still scores it 24 / 100 with Signal Basics 6/6 and Agentic Commerce 0 / 5. Contrast the ceiling sites that publish machine checkout discovery:
| Domain | Score | Signal | Tech | Integration | Commerce | Source |
|---|---|---|---|---|---|---|
| marketontology.com | 24 | 6 / 6 | 0 / 4 | 0 / 10 | 0 / 5 | Agent Scan |
| metareva.com | 100 | 6 / 6 | 4 / 4 | 10 / 10 | 5 / 5 | Agent Scan |
| robauto.ai | 98 | 6 / 6 | 4 / 4 | 9 / 10 | 5 / 5 | Agent Scan |
Most-visited scored sites on the Agent Readiness Index still sit at a median of 20 with a max of 75 — crawl heat without agent surfaces is the common pattern, not the exception.
{
"as_of": "2026-09-29",
"thesis": "ai_traffic_is_not_ai_referral",
"ai_search_90d": {
"total_page_views": 1305282,
"ai_agent_views": 287458,
"ai_traffic_percentage": 22.02,
"llm_crawler_visits": 154577,
"ai_referral_visits": 0
},
"readiness_index": {
"median": 20,
"max": 75,
"scored": 79,
"blocked": 20
},
"example_scans": {
"marketontology.com": {"score": 24, "commerce": "0/5"},
"metareva.com": {"score": 100, "commerce": "5/5"},
"robauto.ai": {"score": 98, "commerce": "5/5"}
}
}
One practical next step
If your dashboards show AI bots but no AI-attributed arrivals, treat crawl as necessary and insufficient. Run a free Agent Scan on your public domain, then ship the agent surfaces the scan flags — llms.txt and robots are the start; Link headers, API catalog, MCP/A2A cards, Content Signals, and commerce discovery (ACP/UCP/x402) are how crawlers become callable products. Learn more in the Robauto Learn guides, and watch the live taxonomy on AI Search Data.
Sources
- Robauto AI Search Data
- Agent Readiness Index
- Agent Scan — marketontology.com
- Agent Scan — metareva.com
- Agent Scan — robauto.ai
- Robauto Agent Scan
- Robauto Learn
Where can an agent get this data live?
Robauto MCP — Agent Intelligence & Brand Discovery Infrastructure. A public, stateless Streamable HTTP endpoint at https://mcp.robauto.ai/mcp, callable with no key. Setup and the full tool list are in the Robauto MCP directory.