Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Questions for Matt Cutts?


sailorjwd - 11:20 pm on Nov 11, 2005 (gmt 0)


Please forgive me if I'm wrong on the following logic:

From my review of the site maps statistics page you (Google) seem to be attempting to open files on my website before checking the robots.txt file.

I add entries to the robots.txt with the Disallow so you will not attempt to open them or touch them in anyway.

Am I wrong on this or are you doing these operations backasswords?


Thread source:: http://www.webmasterworld.com/google/31971.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com