- - Search Engines
- -- Ask - Teoma
- ---- A parameter to tell the crawler how how many pages in a second!
pendanticist - 1:02 am on Jan 30, 2005 (gmt 0)
Ohhhh, I don't think several hundred pages per second would go over very well at all. Nope, not at all.
Thread source: http://www.webmasterworld.com/ask_jeeves_teoma/464.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com