Is your robots.txt hiding you from ChatGPT?

ChatGPT and Perplexity each run a search crawler: OAI-SearchBot and PerplexityBot. OpenAI says sites that opt out of OAI-SearchBot won't be shown in ChatGPT search answers, and both companies recommend allowing their crawler if you want to appear.

Do this today:

1. Open yourdomain.com/robots.txt.
2. Look for Disallow rules aimed at OAI-SearchBot, PerplexityBot, or every bot (User-agent: *).
3. If you use Cloudflare or another firewall, check that its bot rules aren't blocking them too.

Blocking GPTBot is a separate choice. It's for model training, not search.

Want to see whether the AIs actually name you? Run a free check.

Sources: OpenAI crawlers, Perplexity crawlers.