- - Search Engines
- -- Ask - Teoma
- ---- A parameter to tell the crawler how how many pages in a second!
Brett_Tabke - 4:07 pm on Feb 10, 2005 (gmt 0)
From the horses mouth: they may support crawl-delay and that would be all.
Clarification will be forthcoming from same horse...
Thread source: http://www.webmasterworld.com/ask_jeeves_teoma/464.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com