meta-externalfetcher

Verified
meta-externalfetcher

The Meta-ExternalFetcher crawler performs user-initiated fetches of individual links to support specific product functions. Because the fetch was initiated by a user, this crawler may bypass robots.txt rules.

Verification Data for meta-externalfetcher

Some bots get impersonated by other bots. This chart shows the percentage of traffic that was verified as meta-externalfetcher.

meta-externalfetcher Crawl Traffic vs Googlebot

We're using Googlebot as a comparison baseline for a major internet bot. This chart shows meta-externalfetcher traffic as a percentage of verified Googlebot traffic.