AI Bot Directory / Meta-ExternalAgent
What is Meta-ExternalAgent?
Meta-ExternalAgent is Meta's bulk crawler that collects web content for training AI models. It doesn't drive traffic back to your site directly, but the content it collects shapes what future models know — and say — about you.
Last 7 days: 4 hits across 1 reporting sites. Live aggregate data on the AI Crawler Traffic Report.
How to spot Meta-ExternalAgent in your logs
Look for this token in the request User-Agent (case-insensitive):
meta-externalagent
Should you allow or block Meta-ExternalAgent?
Blocking it keeps your content out of future training data, at the cost of future models knowing less about you. Most brands chasing AI visibility leave it allowed.
To block it anyway, add this to your robots.txt:
User-agent: Meta-ExternalAgent Disallow: /
Note: robots.txt is a request, not a lock — well-behaved crawlers honor it; verify with your own traffic data.
Is Meta-ExternalAgent visiting your site?
NeverDrafts tracks every AI crawler hit on your site (one snippet, live in minutes) and monitors whether ChatGPT and Claude actually recommend you when buyers ask.
Start monitoring