Free site inspection
Is your site ready for AI agents?
Paste any address. Boberbot runs Cloudflare's 22 agent-readiness checks, tells you your level and hands you the fixes.
Try , or . Nothing is stored.
Nom nom. Back in 5!
Check, fix, guard
The internet's favourite beaver, now making websites SEO- and agent-ready.
Check
Point him at any website. He runs Cloudflare's 22 agent-readiness checks, from robots.txt and sitemaps to AI crawler rules, Content Signals and Markdown for agents, and tells you which level you're on and what's missing.
boberbot.com/?url=yoursite.com
Fix
Put him in your Astro site. At every build he writes robots.txt with AI crawler rules and Content Signals, and an llms.txt from your pages. Markdown copies and Link headers are next.
npx astro add boberbot
Guard
He checks every page's title and description at build time. In strict mode a page that loses them fails the build, so readiness doesn't quietly slip.
boberbot({ strict: true })
Cloudflare's five levels
Each level builds on the one below, like a dam. Most of the web is still on the bottom plank.
Level 1Basic Web Presence
Two of three: robots.txt, a sitemap, Link headers that point agents to useful files.
Level 2Bot-Aware
Rules for AI crawlers in robots.txt, and Content Signals that say how your content may be used.
Level 3Agent-Readable
The same URL answers with Markdown when an agent asks for it.
Level 4Agent-Integrated
One of: an Agent Skills index, an API catalog, an MCP server card or an A2A agent card.
Level 5Agent-Native
Two of three: all four integrations, auth metadata for agents, Web Bot Auth.
Where some sites stand
Checked 7 October 2026 with Cloudflare's scanner, isitagentready.com.
| Site | Level | Content Site |
|---|---|---|
| astro.build | 1 | 3 of 7 |
| wordpress.org | 1 | 5 of 7 |
| www.bbc.co.uk | 1 | 3 of 7 |
| boberbot.com | 4 | 7 of 7 |
| developers.cloudflare.com | 4 | 6 of 7 |
| vercel.com | 5 | 6 of 7 |
Coding agents can hire him too
Everything a person can do here, an agent can do without a browser. That's the point of being agent-ready.
The web API
curl -s https://boberbot.com/api/scan \
-H 'content-type: application/json' \
-d '{"url": "example.com"}'Returns Cloudflare's report shape, a fix per finding and ready-made Markdown for your agent. API docs.
The skill
https://boberbot.com/.well-known/agent-skills/index.jsonTeaches an agent to check a site, install the integration and fix what fails. In-browser agents can also call scan_site on this page through WebMCP. For agents.
Questions on site
Yes. The checker on this page and the Astro integration are free, and the code is MIT licensed.
No. Boberbot runs the rules Cloudflare publishes for isitagentready.com, under the same names, and agrees with Cloudflare's own scanner on 251 of 252 verdicts in our tests. It isn't made or endorsed by Cloudflare.
You can check any site here. The fixes are written for any stack; the integration that applies them for you at build time is for Astro.
Level 5 asks for things most content sites don't have: an MCP server, an A2A agent, sign-in for agents. For a marketing site or blog, Level 3 with all seven Content Site checks is the realistic top.
Nothing about you. Results are cached for ten minutes so a second check of the same address is instant, then dropped. What the checker fetches.