- - Local
- -- Foo
- ---- Attack of the Robots, Spiders, Crawlers.etc
DaveN - 7:57 pm on Nov 28, 2005 (gmt 0)
I've never heard of anyone cloaking the robots.txt file, but I can see no technical difficulty.
I have in the past ;)
Thread source: http://www.webmasterworld.com/foo/9618.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com