Headline numbers
Percentages are of the 5,589 home pages we could read. The other 4,742 domains were left out: 2,097 unreachable or not running a website, 1,729 answered with a bot challenge or refused our request, 471 returned an error or no HTML, 445 disallow crawlers like ours in robots.txt (respected).
What the data says
- The weakest area is Sitemap and llms.txt (on average 3.5 of 8 points); the strongest is AI search access (24.4 of 25).
- 11.5% of readable home pages show fewer than 50 words without JavaScript: to most AI crawlers, which do not run JavaScript, they look almost empty. 70.7% serve 300 words or more in the raw HTML.
- 47.1% publish JSON-LD structured data and 41.9% describe who they are (Organization, WebSite…); 0.5% ship at least one JSON-LD block that does not parse.
- 56.2% have exactly one H1 heading, while 33.3% have none at all.
- 16.8% serve a valid llms.txt, and only 14.4% organise it in sections with at least five links.
- 0.2% use the non-standard
noai/noimageaidirectives, and 1.5% set their home page tonoindex. - Median home page: 152.2 KB of HTML, 685 readable words, 3.0% of the HTML is visible text; 337 home pages weigh more than 1 MB of HTML alone.
Score distribution
A 37.3% · B 26.4% · C 16.3% · D 8.7% · E 11.2% (A ≥ 85, B ≥ 70, C ≥ 55, D ≥ 40, E below 40)
Embed this chart
A PNG version of the chart, refreshed daily. Free to reuse under CC BY 4.0 with the credit link:
Average points per criterion
| Criterion | Max | Average | Share of max |
|---|---|---|---|
| AI search access | 25 | 24.4 | 97.5% |
| Server-rendered content | 20 | 15.3 | 76.8% |
| Title, description, canonical, language | 12 | 9.2 | 76.9% |
| Open Graph | 6 | 3.7 | 61.0% |
| Structured data | 15 | 6.8 | 45.3% |
| Heading structure | 10 | 6.5 | 64.5% |
| Sitemap and llms.txt | 8 | 3.5 | 44.2% |
| Indexable | 4 | 3.9 | 98.5% |
Signal by signal
| Signal on the home page | Sites | Share |
|---|---|---|
| All AI search and browsing crawlers allowed on the home page | 5,191 | 92.9% |
| At least 300 words readable without JavaScript | 3,954 | 70.7% |
| JavaScript-only shell (under 50 words without JS) | 645 | 11.5% |
| Title of 10 to 70 characters | 4,206 | 75.3% |
| Meta description of 50 to 160 characters | 3,001 | 53.7% |
| Any meta description | 4,520 | 80.9% |
| Canonical URL | 3,804 | 68.1% |
| Language declared (<html lang>) | 4,906 | 87.8% |
| Exactly one H1 | 3,140 | 56.2% |
| No H1 at all | 1,863 | 33.3% |
| Two or more H2 headings | 3,666 | 65.6% |
| Open Graph title, description and image | 2,892 | 51.7% |
| Open Graph image | 3,178 | 56.9% |
| Twitter/X card | 2,751 | 49.2% |
| JSON-LD structured data | 2,631 | 47.1% |
| JSON-LD identity (Organization, WebSite…) | 2,344 | 41.9% |
| At least one invalid JSON-LD block | 27 | 0.5% |
| Sitemap (declared or /sitemap.xml) | 4,073 | 72.9% |
| llms.txt | 937 | 16.8% |
| llms.txt with sections and 5+ links | 806 | 14.4% |
| Home page set to noindex | 84 | 1.5% |
| noai / noimageai directive | 11 | 0.2% |
| hreflang alternates | 1,517 | 27.1% |
| Block at least one AI training crawler | 853 | 15.3% |
By popularity rank
Non-overlapping tranches of the Tranco ranking.
| Tranco rank | Scored | Mean score | JS shell | JSON-LD | Open Graph | llms.txt |
|---|---|---|---|---|---|---|
| 1–100 | 47 | 69.3 | 21.3% | 38.3% | 57.4% | 19.1% |
| 101–1,000 | 442 | 74.5 | 10.2% | 50.9% | 59.7% | 25.1% |
| 1,001–5,000 | 2,117 | 73.3 | 13.1% | 47.2% | 52.8% | 19.0% |
| 5,001–10,000 | 2,983 | 73.3 | 10.5% | 46.6% | 49.7% | 13.9% |
By top-level domain
TLDs with at least 30 scored home pages.
| TLD | Scored | Mean score | JS shell | JSON-LD | Open Graph | llms.txt |
|---|---|---|---|---|---|---|
| .com | 2,791 | 76 | 10.5% | 54.4% | 56.8% | 22.0% |
| .org | 303 | 71.3 | 5.6% | 34.0% | 43.2% | 11.2% |
| .net | 280 | 70.4 | 10.0% | 39.6% | 45.7% | 13.2% |
| .ru | 152 | 66.4 | 8.6% | 31.6% | 47.4% | 9.2% |
| .jp | 128 | 68.9 | 10.9% | 34.4% | 62.5% | 4.7% |
| .io | 126 | 82.3 | 6.3% | 58.7% | 69.8% | 40.5% |
| .de | 118 | 76.4 | 5.1% | 51.7% | 40.7% | 11.0% |
| .edu | 94 | 79.6 | 3.2% | 39.4% | 47.9% | 4.3% |
| .gov | 64 | 71.3 | 4.7% | 18.8% | 50.0% | 1.6% |
| .cn | 60 | 54.5 | 23.3% | 11.7% | 18.3% | 3.3% |
| .br | 59 | 79.1 | 10.2% | 59.3% | 52.5% | 18.6% |
| .fr | 56 | 74.5 | 7.1% | 50.0% | 46.4% | 1.8% |
| .uk | 55 | 75.8 | 7.3% | 45.5% | 50.9% | 7.3% |
| .it | 53 | 74.3 | 11.3% | 58.5% | 39.6% | 11.3% |
| .tv | 51 | 70.2 | 13.7% | 49.0% | 41.2% | 3.9% |
By site language
Language declared in <html lang>, for languages with at least 30 scored home pages (683 home pages declare none).
| Language | Scored | Mean score | JS shell | JSON-LD | Open Graph | llms.txt |
|---|---|---|---|---|---|---|
en | 2,959 | 78.1 | 8.6% | 53.3% | 57.2% | 21.9% |
fr | 716 | 71.2 | 24.3% | 46.2% | 53.9% | 17.5% |
ja | 165 | 71.7 | 10.3% | 39.4% | 67.9% | 6.1% |
ru | 157 | 74.1 | 3.8% | 40.1% | 56.7% | 8.3% |
de | 129 | 78.2 | 3.9% | 55.0% | 45.7% | 11.6% |
es | 122 | 79.2 | 7.4% | 60.7% | 57.4% | 8.2% |
zh | 84 | 64.8 | 20.2% | 35.7% | 38.1% | 15.5% |
pt | 77 | 82.2 | 9.1% | 70.1% | 57.1% | 18.2% |
it | 55 | 78.7 | 3.6% | 63.6% | 47.3% | 7.3% |
fa | 41 | 77.6 | 7.3% | 58.5% | 34.1% | 7.3% |
ar | 36 | 80.4 | 2.8% | 61.1% | 52.8% | 13.9% |
ko | 34 | 67.8 | 17.6% | 26.5% | 70.6% | 14.7% |
tr | 31 | 81.6 | 3.2% | 58.1% | 61.3% | 29.0% |
Most common schema.org types
WebSite 31.3%, Organization 27.6%, WebPage 15.9%, BreadcrumbList 10.2%, ImageObject 3.7%, NewsMediaOrganization 3.7%, FAQPage 3.3%, SoftwareApplication 3.2%, CollectionPage 3.1%, ItemList 3.0%, Corporation 2.2%, SiteNavigationElement 1.3%, Person 1.0%, VideoObject 0.9%, Article 0.9%
Beyond the home page
Our audit worker also crawls up to 30 inner pages of index domains when it is not busy with user requests: 4,624 sites and 123,973 inner pages so far (last 45 days). Average scanner score: 86.7 on home pages, 84.8 on inner pages.
- 86.6% of inner pages serve at least 150 words without JavaScript.
- 49.2% carry JSON-LD, 81.4% a meta description, 77.9% a canonical URL, 73.6% exactly one H1.
- 2.6% of inner pages are set to noindex.
- 95 of 4,624 sites block at least one AI search or browsing crawler on some inner pages, through path rules in robots.txt.
- 1,757 sites have near-duplicate inner pages (90%+ identical text) among those sampled.
The 100 best-prepared home pages
Highest scores in the current snapshot (ties broken by Tranco rank). A high score means the home page is easy for AI crawlers to reach and understand; it says nothing about the quality of the site itself.
| # | Domain | Tranco rank | Score | Words | JSON-LD types | llms.txt |
|---|---|---|---|---|---|---|
| 1 | fastly.net | 40 | 100 | 1,673 | 2 | yes |
| 2 | intuit.com | 98 | 100 | 696 | 7 | yes |
| 3 | samsung.com | 123 | 100 | 2,298 | 3 | yes |
| 4 | forter.com | 182 | 100 | 1,276 | 10 | yes |
| 5 | hubspot.com | 260 | 100 | 1,873 | 4 | yes |
| 6 | centinel-analytica.com | 271 | 100 | 939 | 4 | yes |
| 7 | datadoghq.com | 275 | 100 | 1,911 | 4 | yes |
| 8 | unisys.com | 349 | 100 | 3,127 | 1 | yes |
| 9 | dynatrace.com | 363 | 100 | 631 | 6 | yes |
| 10 | atlassian.net | 378 | 100 | 1,362 | 5 | yes |
| 11 | gitlab.com | 399 | 100 | 1,150 | 4 | yes |
| 12 | businessinsider.com | 490 | 100 | 1,363 | 2 | yes |
| 13 | taboola.com | 505 | 100 | 743 | 4 | yes |
| 14 | atlassian.com | 567 | 100 | 1,179 | 4 | yes |
| 15 | wix.com | 594 | 100 | 1,371 | 3 | yes |
| 16 | optimizely.com | 625 | 100 | 307 | 2 | yes |
| 17 | supabase.co | 684 | 100 | 675 | 4 | yes |
| 18 | surveymonkey.com | 685 | 100 | 754 | 1 | yes |
| 19 | auth0.com | 766 | 100 | 1,984 | 5 | yes |
| 20 | statuspage.io | 768 | 100 | 576 | 5 | yes |
| 21 | cloudinary.com | 792 | 100 | 1,594 | 4 | yes |
| 22 | netlify.app | 795 | 100 | 827 | 6 | yes |
| 23 | mixpanel.com | 834 | 100 | 626 | 3 | yes |
| 24 | unpkg.com | 871 | 100 | 595 | 3 | yes |
| 25 | no-ip.com | 922 | 100 | 2,300 | 1 | yes |
| 26 | revenuecat.com | 1,045 | 100 | 1,109 | 2 | yes |
| 27 | netgear.com | 1,060 | 100 | 459 | 2 | yes |
| 28 | terra.com.br | 1,105 | 100 | 586 | 3 | yes |
| 29 | usercentrics.eu | 1,106 | 100 | 2,090 | 3 | yes |
| 30 | singular.net | 1,246 | 100 | 1,483 | 6 | yes |
| 31 | haberler.com | 1,332 | 100 | 2,455 | 4 | yes |
| 32 | notion.com | 1,364 | 100 | 305 | 3 | yes |
| 33 | adroll.com | 1,393 | 100 | 601 | 2 | yes |
| 34 | posthog.com | 1,492 | 100 | 763 | 2 | yes |
| 35 | markt.de | 1,539 | 100 | 1,028 | 1 | yes |
| 36 | therapservices.net | 1,568 | 100 | 1,463 | 7 | yes |
| 37 | surfshark.com | 1,801 | 100 | 1,252 | 1 | yes |
| 38 | rapid7.com | 1,812 | 100 | 1,127 | 2 | yes |
| 39 | hostinger.com | 1,901 | 100 | 2,488 | 7 | yes |
| 40 | intentiq.com | 1,973 | 100 | 1,385 | 5 | yes |
| 41 | crowdstrike.com | 2,100 | 100 | 2,931 | 3 | yes |
| 42 | utoronto.ca | 2,102 | 100 | 1,069 | 2 | yes |
| 43 | livechatinc.com | 2,106 | 100 | 1,143 | 4 | yes |
| 44 | yotpo.com | 2,112 | 100 | 1,923 | 7 | yes |
| 45 | railway.app | 2,165 | 100 | 1,087 | 4 | yes |
| 46 | notion.so | 2,184 | 100 | 305 | 3 | yes |
| 47 | mgid.com | 2,247 | 100 | 675 | 1 | yes |
| 48 | semrush.com | 2,326 | 100 | 1,325 | 1 | yes |
| 49 | jumpcloud.com | 2,332 | 100 | 950 | 4 | yes |
| 50 | ringcentral.com | 2,333 | 100 | 1,255 | 2 | yes |
| 51 | spot.im | 2,346 | 100 | 665 | 4 | yes |
| 52 | wpengine.com | 2,377 | 100 | 902 | 5 | yes |
| 53 | hubspot.net | 2,383 | 100 | 1,873 | 4 | yes |
| 54 | brightspace.com | 2,393 | 100 | 1,391 | 5 | yes |
| 55 | notion.site | 2,399 | 100 | 305 | 3 | yes |
| 56 | scw.cloud | 2,414 | 100 | 2,678 | 4 | yes |
| 57 | websupport.sk | 2,427 | 100 | 1,216 | 3 | yes |
| 58 | samsungelectronics.com | 2,463 | 100 | 2,298 | 3 | yes |
| 59 | urbanairship.com | 2,510 | 100 | 3,211 | 6 | yes |
| 60 | pubnative.net | 2,557 | 100 | 996 | 5 | yes |
| 61 | zscaler.com | 2,592 | 100 | 699 | 5 | yes |
| 62 | duosecurity.com | 2,663 | 100 | 1,144 | 5 | yes |
| 63 | geocomply.com | 2,679 | 100 | 1,051 | 3 | yes |
| 64 | rudderstack.com | 2,683 | 100 | 1,574 | 2 | yes |
| 65 | sportradar.com | 2,731 | 100 | 1,120 | 4 | yes |
| 66 | cookieyes.com | 2,746 | 100 | 730 | 5 | yes |
| 67 | savvis.net | 2,783 | 100 | 1,469 | 1 | yes |
| 68 | mountain.com | 2,868 | 100 | 1,784 | 7 | yes |
| 69 | cloudx.io | 2,871 | 100 | 373 | 3 | yes |
| 70 | cutt.ly | 2,874 | 100 | 3,633 | 6 | yes |
| 71 | redis.io | 2,933 | 100 | 1,131 | 3 | yes |
| 72 | phys.org | 2,940 | 100 | 3,163 | 2 | yes |
| 73 | clerk.com | 2,996 | 100 | 699 | 2 | yes |
| 74 | zapier.com | 3,008 | 100 | 1,688 | 4 | yes |
| 75 | a2hosting.com | 3,021 | 100 | 1,664 | 1 | yes |
| 76 | drpc.org | 3,053 | 100 | 849 | 4 | yes |
| 77 | elespanol.com | 3,156 | 100 | 6,186 | 5 | yes |
| 78 | elevenlabs.io | 3,174 | 100 | 1,361 | 6 | yes |
| 79 | proximus.be | 3,179 | 100 | 686 | 2 | yes |
| 80 | vtex.com | 3,190 | 100 | 1,185 | 3 | yes |
| 81 | sprinklr.com | 3,222 | 100 | 1,532 | 1 | yes |
| 82 | ably.io | 3,223 | 100 | 762 | 6 | yes |
| 83 | postman.com | 3,315 | 100 | 643 | 2 | yes |
| 84 | hotmart.com | 3,344 | 100 | 502 | 7 | yes |
| 85 | adsbynimbus.com | 3,348 | 100 | 522 | 2 | yes |
| 86 | amplify.com | 3,379 | 100 | 895 | 6 | yes |
| 87 | adyen.com | 3,442 | 100 | 515 | 1 | yes |
| 88 | demandbase.com | 3,468 | 100 | 1,067 | 9 | yes |
| 89 | sanity.io | 3,548 | 100 | 1,267 | 2 | yes |
| 90 | replit.com | 3,586 | 100 | 1,236 | 1 | yes |
| 91 | nanit.com | 3,617 | 100 | 1,083 | 6 | yes |
| 92 | razorpay.com | 3,621 | 100 | 3,415 | 2 | yes |
| 93 | owhealth.com | 3,624 | 100 | 1,165 | 3 | yes |
| 94 | opsgenie.com | 3,653 | 100 | 1,123 | 5 | yes |
| 95 | carfax.com | 3,661 | 100 | 383 | 3 | yes |
| 96 | netlify.com | 3,738 | 100 | 827 | 6 | yes |
| 97 | tanium.com | 3,743 | 100 | 611 | 3 | yes |
| 98 | colorlib.com | 3,757 | 100 | 678 | 3 | yes |
| 99 | mygaru.com | 3,769 | 100 | 617 | 2 | yes |
| 100 | signifyd.com | 3,805 | 100 | 1,253 | 5 | yes |
Daily snapshots
| Day | Scored | Mean | JS shell | JSON-LD | llms.txt |
|---|---|---|---|---|---|
| November 16, 2026 | 5,589 | 73.3 | 11.5% | 47.1% | 16.8% |
| November 15, 2026 | 5,517 | 73.3 | 11.6% | 47.1% | 16.7% |
| November 14, 2026 | 5,431 | 73.4 | 11.4% | 47.2% | 16.8% |
| November 13, 2026 | 5,444 | 73.3 | 11.4% | 47.2% | 16.8% |
| November 12, 2026 | 5,441 | 73.3 | 11.4% | 47.1% | 16.8% |
| November 11, 2026 | 5,440 | 73.3 | 11.5% | 46.9% | 16.7% |
| November 10, 2026 | 5,449 | 73.3 | 11.5% | 46.8% | 16.7% |
| November 9, 2026 | 5,462 | 73.3 | 11.4% | 46.8% | 16.7% |
| November 8, 2026 | 4,564 | 73.1 | 11.4% | 46.5% | 16.9% |
| November 7, 2026 | 3,661 | 73.3 | 11.8% | 47.1% | 17.3% |
Look up a domain
See how a domain of the top 10,000 scored in its latest audit, criterion by criterion. For any other site, run the AI visibility checker or a full-site audit.
Download the data
Aggregates and the top-100 leaderboard, under CC BY 4.0: credit “IABIG AI-Readiness Index, iabig.com” with a link to this page.
- readiness.json — current snapshot (all aggregates, breakdowns, leaderboard) and daily history
- readiness.csv — adoption of every signal by rank tranche
Methodology
Domains. The 10,000 registrable domains of the latest Tranco list used by our AI Crawler Census. Each day we audit 1/2 of them, taken across all ranks, so every domain is re-audited every 2 days and each day's snapshot covers every rank tranche. The figures above combine the latest audit of each domain from the last 14 days.
Requests. For each domain we read robots.txt (https, then https://www., then http) and fetch the home page only if robots.txt allows our crawler (iabig-readiness/1.0 (+https://iabig.com/ai-readiness-index/), token iabig-readiness, falling back to the * group), following up to 5 redirects and reading up to 2 MB of HTML. We then request /llms.txt and, if robots.txt declares no sitemap, /sitemap.xml. 12 domains at a time, from one server in Europe; pages are analysed as they were served to us, without running JavaScript, exactly like most AI crawlers see them. Bot-challenge pages (Cloudflare, Akamai, DataDome…) are excluded rather than scored.
Score (100 points).
- AI search access (25 points) — share of the AI search and browsing crawlers we track (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, PerplexityBot, Googlebot, Bingbot…) that robots.txt allows on the home page.
- Server-rendered content (20 points) — readable words in the raw HTML, without JavaScript: 300+ = 20, 150+ = 12, 50+ = 6.
- Title, description, canonical, language (12 points) — title of 10–70 characters (4, or 2 if present), meta description of 50–160 characters (4, or 2), canonical URL (2),
<html lang>(2). - Open Graph (6 points) — og:title, og:description, og:image (2 each).
- Structured data (15 points) — at least one valid JSON-LD block with a schema.org type (10), including an identity type such as Organization or WebSite (5).
- Heading structure (10 points) — exactly one H1 (6, or 3 if several), two or more H2 (4, or 2 for one).
- Sitemap and llms.txt (8 points) — sitemap declared in robots.txt or at /sitemap.xml (4), valid llms.txt (2) organised in sections with 5+ links (2).
- Indexable (4 points) — no noindex in the robots meta tag or X-Robots-Tag header.
Grades: A ≥ 85, B ≥ 70, C ≥ 55, D ≥ 40, E below. The rubric measures how easily an AI crawler can reach and understand the home page, not the quality, honesty or usefulness of a site. robots.txt is parsed with the RFC 9309 parser of our robots.txt tester.
Limits. One page per domain (inner pages are sampled separately, see above); sites may serve different content by country, device or user agent; a JavaScript-only home page may still be indexed by crawlers that render JavaScript, such as Googlebot. No page content is stored: only the measured signals.