IABIGFrançais

Can ChatGPT, Claude and Perplexity see your website?

Enter a URL: in a few seconds, the checker tells you whether AI crawlers can read your page, what they actually see, and whether it hides instructions aimed at AI assistants.

Free, no sign-up. 20 checks per hour. Results are cached for one hour.

What the checker looks at

AI crawler access

Your robots.txt is evaluated under RFC 9309 for 20 crawlers from OpenAI, Anthropic, Perplexity, Google, Microsoft, Apple, Mistral, Meta and more, separating search from training.

Readable without JavaScript

Most AI crawlers do not run JavaScript. The checker measures the text actually present in the HTML your server sends.

Structure signals

Title, meta description, H1, language, canonical URL, JSON-LD structured data, sitemap and llms.txt.

Prompt injection

Hidden text, HTML comments and invisible characters carrying instructions for AI tools: a common sign of a hacked site.

Why it matters

A growing share of searches now goes through assistants such as ChatGPT, Perplexity, Claude and Google's AI Overviews. These products rely on crawlers that fetch web pages so they can cite their sources. An overly strict robots.txt, a site rendered entirely in the browser, or a firewall that blocks unknown bots can make your site invisible in those answers, often without you noticing.

You may also want to keep your content out of AI training while still being cited in answers. That is possible, because AI companies use different crawlers for training and for search. The checker shows exactly which ones are allowed.

The score out of 100 is indicative: AI search crawler access (40 points), readability without JavaScript (25), structure signals (20), files for crawlers (10) and indexing (5). It does not measure the quality of your content, which remains the main reason a page gets cited.

More free tools

AI crawler directory → · AI crawler observatory →