Toolbox
ToolsDocsProAll the Possibles

All 14 tools / Crawlers, links and search

Read a site's sitemaps, count the URLs and fetch a sample to find the ones that are not a clean 200.

Sitemap checkFreeFor site owners and developers

10 min

saved on a typical run. Our estimate, against opening ten URLs from the sitemap one at a time and noting each status.

Before: what you give it

The example input, as typed in. You give it a page address.

url: https://allthepossibles.com
sample: 10

After: what comes back

The first lines of a real run of the tool's own code on that input, fetched live when the sample was made, so the live page can differ from it. Nothing here is edited by hand.

https://allthepossibles.com: 15 URLs in 1 sitemap(s), robots.txt lists one
  200  urlset  15  https://allthepossibles.com/sitemap.xml
hosts: allthepossibles.com (15)
lastmod: 0 with, 15 without
sample: 10 checked, 0 not 200
  200  GET  https://allthepossibles.com/
  200  GET  https://allthepossibles.com/guides
  200  GET  https://allthepossibles.com/guides/free-vpat-accessibility-conformance-report-generator
  200  GET  https://allthepossibles.com/guides/check-which-ai-crawlers-your-site-blocks
  200  GET  https://allthepossibles.com/guides/wcag-22-contrast-target-size-checker
  200  GET  https://allthepossibles.com/notes
  200  GET  https://allthepossibles.com/notes/mcp-registry-scan
  200  GET  https://allthepossibles.com/notes/ai-crawlers-122-sites
  200  GET  https://allthepossibles.com/privacy
  200  GET  https://allthepossibles.com/terms
... full output on the tool page

What you get

Sitemaps found, URL and host counts, lastmod summary, and the status of each sampled URL

What it cannot do

Free tier samples up to 25 URLs and reads index files one level deep; it checks status codes, not page quality.

Who it is for

  • Site owners
  • Developers

Free and Pro

Free10 runs a day per IP address.
ProNo daily limit, 300 requests a minute.

Daily caps for every tool

Use it from your assistant

The tool is called check_sitemap. Connect the server once, then ask for it by name or describe the job. Install steps.

claude mcp add --transport http toolbox https://toolbox.allthepossibles.com/mcp
curl -X POST https://toolbox.allthepossibles.com/api/sitemap -H 'content-type: application/json' -d '{"url":"https://allthepossibles.com","sample":10}'

Try it here

The form starts with the same example input, so you can run it first and then swap in your own.

More in crawlers, links and search

All crawlers, links and search tools