- - Google
- -- Google News Archive
- ---- Google.com now has no robots.txt?
jesserud - 8:40 pm on Sep 1, 2003 (gmt 0)
[google.com...] is a 302 redirect. A spider could index the 302, but there's no "real" content for a spider to index (or links for a spider to follow) at [google.com...]
Thread source: http://www.webmasterworld.com/google_archive/16587.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com