Page is a not externally linkable
- Search Engines
-- Ask - Teoma
---- A parameter to tell the crawler how how many pages in a second!
jdMorgan - 12:16 am on Jan 30, 2005 (gmt 0)Thread source:: http://www.webmasterworld.com/ask_jeeves_teoma/464.htm
Similar to "Crawl-delay [google.com]" as defined as robots.txt extensions by Yahoo and MSN?
Brought to you by WebmasterWorld: http://www.webmasterworld.com