Page is a not externally linkable
- Search Engines
-- Ask - Teoma
---- Ask eating bandwidth


abbeyvet - 11:39 pm on Jul 17, 2005 (gmt 0)


I had to block it to stop it - the crawl delay did not work. However a day later I set up the crawl delay and removed the block - now it is there all the time but playing nicely. I set the delay to 180, and it is duly getting about 500 pages a day.


Thread source:: http://www.webmasterworld.com/ask_jeeves_teoma/504.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com