Any idea of what this spider is? I'm hesitating to believe it actually belongs to Alta Vista despite the "Scooter" in the UA.
volatilegx
3:45 am on Mar 5, 2003 (gmt 0)
On second glance this appears it might be InfoSpiders pay for inclusion site checking bot that just checks to see if a page exists?
jdMorgan
4:34 am on Mar 5, 2003 (gmt 0)
volatilegx,
Haven't seen that one - The IP does trace back to infospider/proboost.com. I'm not familiar with them, though.
Did it fetch robots.txt, just do a HEAD request on a single page, or what?
Thanx, Jim
volatilegx
2:59 pm on Mar 5, 2003 (gmt 0)
I'm not sure exactly what they requested. Somebody else asked me. But the context of their question leads me to believe it is a page verifier by a pay for inclusion company.