Forum Moderators: open

Message Too Old, No Replies

Are these spiders?

         

terryl

9:57 am on Jun 28, 2001 (gmt 0)

10+ Year Member



Hi,I'm new here. I got a question if anyone knows the following names are spiders, and whose spiders are they.

LECodeChecker/3.0 libgetdoc/1.0,
libwww-perl/5.44,
lwp-trivial/1.34, 1.32, and
LWP::Simple/5.48

Woz

10:03 am on Jun 28, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi terryl, welcome to WmW,

LECodeChecker/3.0 libgetdoc/1.0 is just Link Exchange checking that you have their banner code in place. Nothing to worry about there and whatever you do, don't ban it.

The others are Perl routines so I will let the Perl experts handle those.

Onya
Woz

Ove

12:18 pm on Jun 28, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Anyone have a list of spiders
who they are and what engine they belongs too

/Ove

Macguru

1:24 pm on Jun 28, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi Ove,

You can get such a list(and many more usefull informations) by cliking on the link on the upper right corner of this page.

volatilegx

5:46 pm on Jun 28, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Terryl,

The bottom three user agents are standard User Agents used by some perl modules. They may or may not belong to search engines. I wouldn't rely on these User Agent names to tell you anything because they can be used for so many things.

terryl

4:58 am on Jun 29, 2001 (gmt 0)

10+ Year Member



Hi everybody,

Thank you for the reply. I also checked with SE World, but didn't find any that match, so I thought maybe someone here might know something. Thanks a lot anyway.

Jaf

2:20 am on Jul 1, 2001 (gmt 0)

10+ Year Member



>Anyone have a list of spiders
>who they are and what engine they belong to

I have a list of search engine spiders and other agents at
[jafsoft.com...]

The lists aren't exhaustive (I got fed up
documenting all the excite bots once they
moved off musical instruments as names :-)