Forum Moderators: mack

Message Too Old, No Replies

MSNBot Crawl delay

the optimal delay time

         

docny

3:26 pm on Jun 22, 2004 (gmt 0)

10+ Year Member



I was wondering what would be the ideal delay time for robot crawl if it chewing your bandwidth...without compromising page indexing

Sanenet

3:38 pm on Jun 22, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I would say between 5 - 20 seconds, depending on available bandwidth and traffic.