Page is a not externally linkable
- Google
-- Google News Archive
---- Google.com now has no robots.txt?


DerekH - 7:15 pm on Sep 1, 2003 (gmt 0)


So let me get this right...
If google has no robots.txt, it will index all its cached pages, and put them in its cache, with the google header on top. And then next month...

Look out Capn, it's gonna blow!
DerekH


Thread source:: http://www.webmasterworld.com/google_archive/16587.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com