Is your website readable for AI? The technical GEO checklist

You publish strong content, your brand is well known, and yet you show up nowhere in ChatGPT or Perplexity. Frustrating, because on the face of it you are doing everything right. Often the cause is not what you write, but a technical setting that unintentionally shows AI bots the door.

In this guide you work through a concrete, technical GEO checklist. No vague advice, but the exact spots where things go wrong: robots.txt, GPTBot, schema markup and structure. It is low-hanging fruit you can pick up today to make sure your website is readable for AI.

Is my website accidentally blocking ChatGPT’s crawlers?

This is the most underestimated cause of AI invisibility. Many sites block AI bots without anyone consciously choosing to. A web developer once put a rule in the robots.txt, a security plugin was set too strictly, or a CDN filters out suspicious traffic.

The AI crawlers you want to let in each have their own name:

• GPTBot: OpenAI’s crawler (ChatGPT)
• OAI-SearchBot: for ChatGPT’s search function
• PerplexityBot: Perplexity’s crawler
• ClaudeBot and anthropic-ai: Anthropic’s crawlers
• Google-Extended: determines whether Google uses your content for AI Overviews and Gemini

Open your own yourdomain.com/robots.txt and look for rules like User-agent: GPTBot followed by Disallow: /. Is it there? Then you are actively blocking ChatGPT’s crawlers. This often happened out of privacy caution, but it directly costs you your spot in AI answers.

An important nuance: blocking is a choice, not an accident that is wrong by definition. But if you want to be found, you have to allow these bots deliberately. After all, more and more B2B buyers start their orientation in an AI tool rather than in Google.

How do I make my site technically accessible to AI bots like GPTBot?

Accessibility for AI bots goes beyond your robots.txt alone. It is a small chain of settings that all need to be right. Work through these points:

1. Explicitly give AI crawlers access

Make sure your robots.txt does not block the relevant bots. In most cases, no Disallow at all for these user-agents is the safest choice if you want visibility.

2. Check your firewall, CDN and plugins

Tools like Cloudflare or security plugins sometimes flag AI bots as unwanted traffic. Check your bot settings and, where needed, add an exception for the known AI crawlers. This is a common blind spot: your robots.txt can be perfectly fine while your firewall still keeps the door shut.

3. Server-side rendering over heavy JavaScript

Many AI crawlers read JavaScript less well than a modern browser. If your most important content only becomes visible after running lots of scripts, the bot may see an empty page. Make sure your core text sits in the HTML source code, not only loaded client-side.

4. Keep your sitemap and internal links in order

An up-to-date sitemap.xml and clear internal links help bots find all your relevant pages. Orphan pages without any internal link are often simply missed.

Want to understand more deeply how this ties into your findability? Then read our ultimate GEO guide and the explanation of what GEO exactly is.

Which schema and structure do I need to be included in AI answers?

Access is step one. But AI models prefer to cite content they can easily understand and summarize. Structure and schema markup are your best friends here.

Structure for readability

AI answers are built up from clear, well-defined pieces of information. Help the model by:

• Using clear H2 and H3 headings that answer a concrete question
• Writing short paragraphs, not one wall of text
• Using bullet points and step lists wherever possible
• Applying a question-and-answer structure, because that is how people talk to AI too

Add the right schema

Schema (structured data in JSON-LD) explicitly tells machines what a piece of content means. The most valuable types for GEO:

• Organization and WebSite: who you are and what your brand is
• Article or BlogPosting: for your knowledge articles
• FAQPage: for your frequently asked questions, ideal for AI answers
• Product or Service: for your offering
• BreadcrumbList: helps clarify context and hierarchy

A growing share of AI citations goes to pages that are worded explicitly, in a structured and factual way. Want to know how to show up specifically in the big tools? Then check out our guides on getting found in ChatGPT, getting found in Perplexity and getting found in Google AI Overviews.

The quick audit: your GEO checklist in 8 points

Work through this list. Every point you cannot tick off is a potential reason why you stay invisible:

1. Your robots.txt does not block GPTBot, PerplexityBot, ClaudeBot or Google-Extended
2. Your firewall or CDN lets the known AI bots through
3. Your core content sits in the HTML source code, not only in JavaScript
4. You have an up-to-date sitemap.xml that contains all important pages
5. Your pages use a clear heading structure with logical H2s and H3s
6. You have implemented relevant schema markup (at least Organization and Article)
7. Your important questions sit in an FAQ with FAQPage schema
8. Your content is worded factually and directly, easy to cite

Not ticking off four or more points? Then you are probably leaving visibility on the table that can be won with a few hours of work. This is exactly why GEO often delivers faster results than classic SEO, as we explain in GEO vs SEO.

What you can rightly expect from a good approach

A technical audit is not a one-off trick. AI tools, crawlers and their preferences move fast. What you can rightly expect from an honest approach: a level-headed screening of your site, a priority list based on impact, and clear explanations about what is and is not within your reach.

You do not have to solve everything at once. Start with the blockers (robots.txt and firewall), then the structure, then the schema. After that, measure whether you are making progress. How you do that, you can read in our guides on measuring AI share of voice and the tools for AI visibility.

Frequently asked questions

How do I know if my website is accidentally blocking ChatGPT’s crawlers?

Open yourdomain.com/robots.txt in your browser and look for User-agent: GPTBot with Disallow: / underneath it. If it is there, then you are blocking ChatGPT. Also check your firewall or CDN, because it can hold AI bots back independently of your robots.txt. If in doubt, we will take a free look with you.

How do I make my site technically accessible to AI bots like GPTBot?

Allow the known AI crawlers in your robots.txt, set exceptions in your firewall, make sure your content sits in the HTML source code (not only in JavaScript) and keep your sitemap up to date. Those four fixes solve the vast majority of accessibility problems.

Which schema and structure do I need to be included in AI answers?

Use JSON-LD schema for Organization, Article and FAQPage as a base. Combine that with a clear heading structure, short paragraphs and a question-and-answer setup. AI models prefer to cite content they can quickly understand and summarize.

Does this technical checklist also help if my classic SEO is already solid?

Yes. Good SEO is a strong foundation, but AI bots have their own access rules and preferences. A site that scores perfectly in Google can still be invisible in ChatGPT because of a single block in the robots.txt. Also check out whether SEO is dead because of AI for the broader context.

Is this relevant for B2B and smaller companies?

Definitely. More and more B2B buyers and SME decision-makers orient themselves via AI tools before they get in touch. How you respond to that, you can read in GEO for B2B and GEO for small businesses.

Ready to make your site readable for AI?

The technical checklist is deliberately kept simple, because most of the gain sits in the basics: make sure AI bots are allowed in, structure your content clearly and add the right schema. Work through the eight points and you are already further ahead than most competitors.

Want us to take it on for you, from audit to execution? We advise and execute: strategy, lead gen, ads, SEO, GEO and web, as one honest, transparent and approachable Belgian partner. See what our GEO agency can do for you.

We are a small team, so we move fast and often do more than you expect. Schedule your free intake.