Fix GPTBot Blocked
GPTBot is OpenAI's web crawler. If your robots.txt blocks GPTBot, your pages won't be indexed for ChatGPT answers. Millions of users rely on ChatGPT for discovery—blocking GPTBot means missing that traffic.
Common causes
- Disallow: / for GPTBot in robots.txt blocks the entire site.
- Critical paths (blog, docs, products) are disallowed for GPTBot.
- User-agent: GPTBot is in a group with broad Disallow rules.
How to fix
- Add Allow: / for GPTBot before any Disallow if you want full access.
- Use our AI Bot Access Checker to see exactly which rules apply to GPTBot.
- Test specific URLs with Blocked by AI Tester (select GPTBot) before changing production.
FAQ
- What is GPTBot?
- GPTBot is OpenAI's crawler. It indexes web pages to improve ChatGPT. Allow it if you want your content in ChatGPT answers.
- Should I block GPTBot?
- Only block if you explicitly don't want your content in ChatGPT. Most sites benefit from allowing it.
- How do I allow GPTBot for some paths only?
- Use Allow: /blog before Disallow: /admin. Order matters—first matching rule wins.