Page is a not externally linkable
- Search Engines
-- Ask - Teoma
---- A parameter to tell the crawler how how many pages in a second!


sdani - 11:53 pm on Jan 29, 2005 (gmt 0)


I met an Ask Jeevs engineer today (Teoma guy).. and in informal discussion he said it would be good if there was a parameter which tells us how hard can we hit your web site.. like "you can get upto 100 pages per second.. ".

I thought that was genious idea.. Doesn't something like that already exist in RFC?


Thread source:: http://www.webmasterworld.com/ask_jeeves_teoma/464.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com