Forum Moderators: open

Message Too Old, No Replies

Lite Bot 0616B

Ver numbers decreasing?

         

MarieC

7:33 am on Mar 16, 2003 (gmt 0)

10+ Year Member



Came from 66.139.78.135.

Version started with Lite Bot 0816b. Then 0916b. Now, 0616B. Strange. Probably not really a version number?

Since [webmasterworld.com...] is closed.

Dreamquick

1:20 pm on Mar 17, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm tempted to also have a read of this discussion [webmasterworld.com] as it seems rather relevant to your current situation.

Potentially a variant on the bot mentioned in the second post may be similar to what you are seeing as it's main feature is the changing UA string which uses a variety of names & versions - does this sound familiar? :)

My view is block them until you know what they do, preferably using a pattern match against the UA as this will overcome the version number issue.

Why block them?

Well quite frankly they are exhibiting rather suspicious behaviour for an "honest" crawler which would make me liable to watch it carefully, however if it ignores robots.txt (as suggested) then I'd block it in a heartbeat...

- Tony

WitchLars

6:54 pm on Mar 17, 2003 (gmt 0)

10+ Year Member



I've seen varying versions of these spiders:

Demo Bot
Educate Search
Full Web Bot
Lite Bot
Production Web Bot
Production Bot

They have all fallen into my spider trap after following links with the tempting word 'guestbook' in them. They come in from various IPs with differing version numbers.

Personally, I've written them all off as email harvesters since they go straight for the fake guestbook, ignoring all other links.

-Lars