Forum Moderators: open
So does anyone know anything about them?
They seem to be behaving like regular crawlers whilst trying to access very few pages (~12) a week. Googlebot still appears to be indexing the site and I've seen no errors reported in WMT although mod_defensible returns a non standard error message not a 404 or 403...
64.233.172.1
74.125.75.1
72.14.193.67
Thanks.
Hugh
Denying these tools (which actually obscure the visitors IP range) is not the same as denying a google robot crawl. Nor will denying these tools affect the normal 66.249.xx.xx spidering.