Don, The anchor element in the user agent string makes it look like a log file spammer but then requiring HTTP authentication for access makes no sense at all. Did it request robots.txt?
Please disable "graphic smile faces" in your message when you post a user agent string that includes a semicolon followed by a right parenthesis.
Thank you . . .
wilderness
3:07 am on Jun 15, 2003 (gmt 0)
Warm,
No Robots. No images.
It only spidered a few pages at very distant intervals. In fact it was five hours between the 1st visit and the followup denial.
Don
WarmGlow
3:46 am on Jun 15, 2003 (gmt 0)
Thanks, Don. It appears that "tovero bot" is a horse of a different color. ;) I'll let it roam free since I have no horses on my web sites.
Yidaki
5:45 pm on Jul 2, 2003 (gmt 0)
Just a follow up:
Be carefull with allowing this ip / bot! It's right now hammering my forum very hard - ignoring robots.txt - i blocked the ip. The ip also resolves back to a adult host! Could be a vhost using the same ip. Watch out, i'd say!
nilloc
6:13 am on Jul 3, 2003 (gmt 0)
HI,
Tovero is a specialized search engine in german language for all topics concerning "Horses" and "Horse Riding", normaly they only spider pages where keywords to the above are found.
The website is called: "Die pferdige Suchmaschine" (or "horse topics search engine").