AI Bot Directory / YouBot
What is YouBot?
YouBot builds the index behind You.com's AI search and answer products. Pages it crawls can be retrieved and cited in AI answers — this is the crawler that most directly turns your content into AI visibility.
Last 7 days: 2 hits across 1 reporting sites. Live aggregate data on the AI Crawler Traffic Report.
How to spot YouBot in your logs
Look for this token in the request User-Agent (case-insensitive):
youbot
Should you allow or block YouBot?
Blocking it removes your pages from AI answer retrieval — if you want to be cited by AI assistants, this is the last crawler you should block.
To block it anyway, add this to your robots.txt:
User-agent: YouBot Disallow: /
Note: robots.txt is a request, not a lock — well-behaved crawlers honor it; verify with your own traffic data.
Is YouBot visiting your site?
NeverDrafts tracks every AI crawler hit on your site (one snippet, live in minutes) and monitors whether ChatGPT and Claude actually recommend you when buyers ask.
Start monitoring