Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Altavista Scooter eats up too much trafic
MarkHutch - 5:28 am on Jan 24, 2004 (gmt 0)
You can disallow it, but I don't think you can slow it down. How fast is it getting your pages?
Thread source:: http://www.webmasterworld.com/robots_txt/249.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com