Fix robots.txt Disallow All for AI
Disallow: / with User-agent for AI bots blocks everything. AI systems can't index your site.
Common causes
- Disallow: / for * or for AI user-agents.
- Intended to block one bot but blocks all.
- Copy-paste from overly restrictive template.
How to fix
- Add Allow: / for AI bots before Disallow if partial block needed.
- Use Robots.txt for AI Bots to see current rules.
- Test with AI Bot Access Checker.