Hotbot-Lycos or Slurp?

Smarter Stats getting confused?

[roodle]

Hi,

I have a site that, according to Smarter Stats, is getting spidered by the Hotbot-Lycos robot over 200 visits a day. Why? - I dont know. I'm not even sure it IS the Hotbot-Lycos robot, since there's no sign of it in the logs. Could it be confused with Yahoo Slurp? What is the user agent for the Hotbot-Lycos? I need to clarify this before I go and ban a robot unnecessarily...

Thanks

[fiestagirl]

The user agent of Lycos spider is:
Lycos_Spider_(modspider)
I'm seeing it come from ip:
209.202.248.211-214

[roodle]

Well, it turns out that the robot in question is in fact "slurp". Still not sure why Smarter Stats identifies it as "Hotbot-Lycos". Even after banning slurp it's still back 20-odd times a day trying to get past the robots.txt!

[Dijkgraaf]

How have you banned Slurp.
Via robots.txt?
Note that the UA is case sensitive, so you do need to capitilise the S.

[roodle]

Yep, I used capital S. I read the info on the Yahoo site. I noticed AWStats identifies Slurp as "Inktomi Slurp", which I presume is correct.

BTW, anyone know why Smarter Stats counts robot visits with the normal visits? Doesn't seem logical to me, and I can't see a way to filter them out.

[Dijkgraaf]

Nope. For the robot UA it is just Slurp
See [help.yahoo.com...]

[roodle]

I DID use just "Slurp". I was commenting that different stats software identify the same robot differently.