Forum Moderators: DixonJones

Message Too Old, No Replies

Last two days a blizzard of spider activity

Bad time of year to go down at all.

         

jranes

3:35 pm on Sep 7, 2003 (gmt 0)

10+ Year Member



For the last two days I have had every spider I have ever seen cranking on some of my sites. Shure hope my hosting doesn't go down now. Seems like last year at this time spidering was especially heavy. Anyone else out there getting the fast/ink/google blizzard right now?

jeremy goodrich

7:17 pm on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Last few times I looked at a more granular level in my logs, seems I was getting hammered from everywhere :)

Bad news though is that the only "productive" spidering was driven by the Googlebot, and a small amount by Inktomi.

The rest, might as well have saved their bandwidth for something more "productive" though I've not bothered to hand check & see if they listed me or not.