Quattr leads AEO, SEO, and content rankings on G2 Spring 2026. View our G2 badges →
Request demo
Request demo

AI visibility

How to check if GPTBot or ClaudeBot crawls your site

ai-crawler-check a saved expert workflow your assistant follows, in Claude, ChatGPT or Cursor

A free AI-crawler diagnostic for any site: fetch its public robots.txt, read it against the current AI bot roster (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and friends), and name what each block actually costs.

Try it

is GPTBot crawling us

Private beta Part of the quattr-ai-search plugin, rolling out org by org. Request access ↗

Say any of these

  • check my robots.txt
  • are we blocking AI crawlers?
  • is my site open to ChatGPT?
  • can AI bots read my site
  • AI crawler check on example.com
  • what does blocking GPTBot cost?

You never name the skill or a tool, the assistant routes on what you asked. These are the phrasings it recognises for this one.

And when it stays out of the way

Not for log or crawl-activity questions on connected Quattr data ("are AI bots actually crawling us", "GPTBot activity in our logs").

Use it instead of ai-crawler-readiness when there is no Quattr account or the subject is any site's public robots.

What it reads

This one answers from evidence rather than from your metrics, it fetches and reads what it needs, so it runs no analyses against your data.

The numbers behind it

Reports these numbers feed

AI bot activity report

What it refuses to do

  • Per-bot blocking is a per-surface business decision with named costs, present the documented trade-offs, never prescribe a blanket allow or deny.
  • Contested rows stay contested in the output: Perplexity's stealth-crawling dispute, Bytespider's compliance, xAI/Grok's undocumented retrieval.
  • If the gap between the roster's as-of date and today spans a known policy date (e.g., the 2026-09-15 Cloudflare default flip), say the guidance may already be stale and point at the vendor source.

What the answer looks like

Skill: Quick per-bot fetch check. Simulated · illustrative

Is my site open to ChatGPT?

Analysis plan, every step, resolved for you

  • Routed to the governed workflowai-crawler-check
  • Dates bound explicitlyAug 1, 2026
  • Honesty gates armedscope echo · freshness

acme.example allows 10 of 12 AI crawlers, the two blocks have a namable cost.

AI bots allowed
10 of 12 GPTBot, OAI-SearchBot, ClaudeBot, Google-Extended among them
Blocked
PerplexityBot, CCBot Disallow: /, a full block
What the block costs
Perplexity eligibility pages that can't be fetched can't be cited

Aug 1, 2026

⚠ Observationalas of Aug 1, 2026 (public robots.txt, fetched live)IllustrativeOpen in Quattr ↗

Permission isn't behavior, with a Quattr account, ai-crawler-readiness shows what actually got fetched.

A simulated conversation on fictional data. Scope, freshness and the ⚠ Observational marker are attached by the same director that renders every demo here, not written by hand.

Want this Skill running on your own accounts? Every Quattr customer works with an AI Search Strategist who sets it up with you.

Consult an expert