- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- the wrong way to do robots.txt
onedumbear - 8:10 am on Oct 28, 2003 (gmt 0)
yup, that's funny alright.
whats got me curious is what were you doing looking at that? What motivated you to say, "hey, i wonder what the whitehouse robots.txt looks like"?
Thread source: http://www.webmasterworld.com/robots_txt/192.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com