22% of Network Traffic Looks AI. AI Referrals Are Still Zero.

Robauto Team · Published · Last updated

Live Robauto pulse: 22.02% of 90-day page views are AI-classified, but ai_referral visits are still 0. Crawlers ≠ referrals — and readiness median sits at 20.

22% of network traffic looks AI — AI referrals still zero

22.02% of Robauto network page views over the last 90 days look like AI. Measured AI referrals are still exactly zero. That is the gap brands miss when they celebrate crawler hits: visits and crawlers are not the same as referrals that send humans (or shopping agents) to your site.

The live pulse, September 29, 2026

From Robauto AI Search Data (network aggregates, cookie-free pixel):

MetricValueSource
Total page views (90d) 1,305,282 AI Search Data
AI-classified views (90d) 287,458 AI Search Data
AI traffic share 22.02% AI Search Data
ai_referral visits 0 (0%) AI Search Data
Agent Readiness Index median 20 / max 75 (79 scored, 20 blocked of 99 attempted) Agent Readiness Index

Of those 287,458 classified non-human visits, Robauto’s taxonomy splits the traffic so classic SEO crawlers never inflate the AI-search number:

ClassVisitsShareCounts as AI search?Examples
llm_crawler 154,577 53.8% Yes Meta AI, grok_bot, Copilot, Claude, ChatGPT, Grok/xAI, Gemini, Perplexity, DeepSeek
ai_referral 0 0% Yes —
search_bot 97,794 34% No (classic crawlers) AhrefsBot, SemrushBot, Baiduspider, Amazonbot, Applebot
other_bot 34,148 11.9% No Meta External Agent, HubSpot, DuckDuckBot, CCBot
headless 939 0.3% No (automation) screenshot services

Bar chart of Robauto bot taxonomy: llm_crawler 53.8% vs ai_referral 0

API note, unchanged this morning: only llm_crawler + ai_referral are AI search; search_bot and headless are classic crawlers and automation.

What ai_referral actually means

llm_crawler is a bot reading your pages to build answers, indexes, or training corpora — Meta AI alone accounts for about 32.1% of classified visits this window (92,317). That is discovery work. It does not put a shopper on your product page.

ai_referral is the other half of AI search: a real referral when someone (or an agent acting for them) arrives from an AI answer surface with a referrer Robauto can attribute. Across the whole network right now that counter is 0. Brands that only get crawled still see zero AI-attributed arrivals — the crawl log grows while the referral column stays blank.

Crawl volume ≠ agent readiness

The public leaderboard’s #1 site by agent visits this week is marketontology.com (7,922 agent visits in 7 days) — and a fresh Agent Scan still scores it 24 / 100 with Signal Basics 6/6 and Agentic Commerce 0 / 5. Contrast the ceiling sites that publish machine checkout discovery:

DomainScoreSignalTechIntegrationCommerceSource
marketontology.com 24 6 / 6 0 / 4 0 / 10 0 / 5 Agent Scan
metareva.com 100 6 / 6 4 / 4 10 / 10 5 / 5 Agent Scan
robauto.ai 98 6 / 6 4 / 4 9 / 10 5 / 5 Agent Scan

Most-visited scored sites on the Agent Readiness Index still sit at a median of 20 with a max of 75 — crawl heat without agent surfaces is the common pattern, not the exception.

{
  "as_of": "2026-09-29",
  "thesis": "ai_traffic_is_not_ai_referral",
  "ai_search_90d": {
    "total_page_views": 1305282,
    "ai_agent_views": 287458,
    "ai_traffic_percentage": 22.02,
    "llm_crawler_visits": 154577,
    "ai_referral_visits": 0
  },
  "readiness_index": {
    "median": 20,
    "max": 75,
    "scored": 79,
    "blocked": 20
  },
  "example_scans": {
    "marketontology.com": {"score": 24, "commerce": "0/5"},
    "metareva.com": {"score": 100, "commerce": "5/5"},
    "robauto.ai": {"score": 98, "commerce": "5/5"}
  }
}

One practical next step

If your dashboards show AI bots but no AI-attributed arrivals, treat crawl as necessary and insufficient. Run a free Agent Scan on your public domain, then ship the agent surfaces the scan flags — llms.txt and robots are the start; Link headers, API catalog, MCP/A2A cards, Content Signals, and commerce discovery (ACP/UCP/x402) are how crawlers become callable products. Learn more in the Robauto Learn guides, and watch the live taxonomy on AI Search Data.

Sources

Where can an agent get this data live?

Robauto MCP — Agent Intelligence & Brand Discovery Infrastructure. A public, stateless Streamable HTTP endpoint at https://mcp.robauto.ai/mcp, callable with no key. Setup and the full tool list are in the Robauto MCP directory.

All blog posts