Forum Moderators: open

Message Too Old, No Replies

Spider Basics

DO spiders have a set time on each site

         

StanTheMan

4:45 pm on Oct 14, 2003 (gmt 0)

10+ Year Member



I have had a look through my logs, and some of googles freshbot spiders jump through a lot of links and other just go though a few links.

Does googlebot have a set period of links ( three jumps say) before reverting to the next url?

Hope anybody can shed some light on this.

Regards

creative craig

9:49 am on Oct 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have not noticed any pattern on my sites regarding to the links it follows. From what I can see it does what it wants.