Fix Specific Path Blocked for AI
A Disallow rule blocks a path for AI user-agents. Important pages (blog, docs) may be blocked.
Common causes
- Disallow: /admin or /api blocks more than intended.
- Disallow: /private also blocks /private-docs.
- Path pattern too broad.
How to fix
- Use Blocked by AI Tester to test the exact URL.
- Add Allow rule before Disallow for the path you want open.
- Narrow Disallow to specific subpaths.