Page is a not externally linkable
- Search Engines
-- Ask - Teoma
---- A parameter to tell the crawler how how many pages in a second!
Brett_Tabke - 4:07 pm on Feb 10, 2005 (gmt 0)
From the horses mouth: they may support crawl-delay and that would be all. Clarification will be forthcoming from same horse...
Thread source:: http://www.webmasterworld.com/ask_jeeves_teoma/464.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com