Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Google indexes ROBOTS.TXT


henweb - 2:05 pm on Sep 13, 2005 (gmt 0)


Here's a question I thought of while doing a google search on "robots.txt" file - why does the whitehouse site (which comes up about third or fourth) have a /text and /iraq extension on every url they're asking google to ignore? What's THAT about?

Henry


Thread source:: http://www.webmasterworld.com/google/31129.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com