Page is a not externally linkable
- Local
-- Foo
---- lets try this for a month or three...


skipfactor - 3:14 am on Nov 24, 2005 (gmt 0)


>>Well, I understand Brett's issues but there are lot's of other ways to stop rogue bots than to just turn off access to all robots.

As you know, Brett's been hinting at this. Funny, the wild stuff (I thought at the time) I've read here that I thought insane have had a way of becoming quite clear after a few years. Site down for a week, big move, Holidays, what the heck? However, I'm predicting a new robots.txt on 01-Jan. :)


Thread source:: http://www.webmasterworld.com/foo/9593.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com