SEs alive and well

spider feeding frenzy

[oilman]

wow - what a night. I haven't been spidered this hard in long time. Got hit by t-Rex about a dozen times and scooter, slurp, googlebot and Infoseek stopped by to say hi as well as a handful of others. Here's hoping it all bodes well :)

Edited by: oilman

[Brett_Tabke]

Slurp has been going nuts on me everywhere. Spidering everything in sight - even form submitted cgi's. It walked through and pulled everypage available (3000) on another site of mine. Trex has been doing the trex thing, but where is that data going to? Infoseek appears to be in link check only mode. Archie is still as aggressive at link checking and spidering as always - just wish some pages would show up over there.