Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- The Mozilla/5.0 Google bot - What does it do


kryton - 12:59 am on Mar 23, 2005 (gmt 0)


I've checked my logs and that "Mozilla Googlebot" has not visited any pages that I have banned in robots.txt. I doubt Google would do such a thing? Maybe it was someone else just using the same UserAgent? I would be interested to know if anyone else reports it visiting banned pages in robots.txt.


Thread source:: http://www.webmasterworld.com/google/28571.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com