Page is a not externally linkable
- Local
-- Foo
---- Attack of the Robots, Spiders, Crawlers.etc


2by4 - 1:15 am on Nov 30, 2005 (gmt 0)


this is so confusing, here I am, surfing webmasterworld with cookies off, using the googlebot useragent, and it's all there. I thought cookies were required to view content?

How is this supposed to stop bad bots?


Thread source:: http://www.webmasterworld.com/foo/9618.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com