Can Claude read your site?

Anthropic uses three robots, each with its own robots.txt name:

• ClaudeBot collects content that may be used for model training.
• Claude-SearchBot indexes pages to improve Claude's search results.
• Claude-User fetches pages when a Claude user asks a question.

Anthropic says disabling Claude-SearchBot or Claude-User may reduce your site's visibility in user search results.

Do this today:

1. Open yourdomain.com/robots.txt.
2. Look for Disallow rules aimed at Claude-SearchBot, Claude-User, or every bot (User-agent: *).
3. Want to opt out of training only? Block just ClaudeBot.

Want to see whether the AIs actually name you? Run a free check.

Sources: Anthropic: how site owners can control its crawlers.