Why this matters
More and more people no longer search on Google, but ask their question directly to
ChatGPT, Perplexity or Gemini. Those tools can only recommend you if their crawlers are
allowed to read your website. Many sites block those crawlers, often by accident, via a
single line in their robots.txt.
What this tool checks
We fetch your robots.txt and look, per AI search engine, at whether the
corresponding crawler (such as GPTBot for ChatGPT, ClaudeBot for
Claude or Google-Extended for Gemini) gets access or is blocked. A block means
that AI cannot read your content and therefore cannot cite you.
And if I am blocked?
No panic. Often you can fix it by adjusting a few lines in your robots.txt. If
you want to become structurally more discoverable in AI search engines, take a look at our
AI search optimization (GEO).