Docs

How to check a site, add Boberbot to an Astro site, and hand the work to a coding agent.

Boberbot does two things:

1. Checks any website against the agent-readiness rules Cloudflare publishes for isitagentready.com: 22 checks, a level from 0 to 5, and a fix for everything that fails. Use the box on the home page, the web API, or soon the CLI.
2. Makes Astro sites ready at build time. The integration writes robots.txt with AI crawler rules and Content Signals, writes llms.txt, and checks every page’s title and description. Getting started.

Pages

• Getting started: add the integration to an Astro site.
• Integration options: every setting, with its default.
• The 22 checks: what Cloudflare checks and what Boberbot does about each.
• The CLI: boberbot scan, its flags and exit codes.
• Web API: POST /api/scan, limits and the response.
• For coding agents: the skill, an AGENTS.md snippet and Markdown output.
• Boberbot’s checker: what it fetches and how to recognise it.

Every page here is also served as Markdown: request it with Accept: text/markdown.