Welcome to WebmasterWorld Guest from 50.19.57.50

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

Newbie Spiders...

Laundry List of Unknown Spiders...

     
1:53 pm on May 8, 2001 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 29, 2001
posts:406
votes: 0


I have found the following spiders indexing (or at least visiting...) a number of my managed sites. Does anyone know where they come from?

ia_archiver
Zyborg 1.0
PolyBot 1.0
MLLXPC
Mercator-2.0
LinkWalker
WebSauger
Teoma (A new SE ready to debut?)
dllbot
architextSpider
OpenFind.Shark
Mc_Kalyan_21
ru_robot

8:35 pm on May 8, 2001 (gmt 0)

Full Member

joined:Jan 24, 2001
posts:230
votes: 0


Do a Site Search [searchengineworld.com]. There is info on this web site for most (if not all) the spiders on your list.

Jaf

11:36 pm on May 9, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:May 9, 2001
posts:45
votes: 0


Most of these are listed on the webbots page I maintain at
[jafsoft.com...]

That page lags behind the discussions here (I only just found this forum), but most of the ones you list are familiar to me

11:39 pm on May 9, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 17, 2000
posts:2924
votes: 0


Jaf, welcome to WmW.