Welcome to WebmasterWorld Guest from 54.159.214.250

Forum Moderators: Ocean10000 & incrediBILL

Newbie Spiders...

Laundry List of Unknown Spiders...

   
1:53 pm on May 8, 2001 (gmt 0)

10+ Year Member



I have found the following spiders indexing (or at least visiting...) a number of my managed sites. Does anyone know where they come from?

ia_archiver
Zyborg 1.0
PolyBot 1.0
MLLXPC
Mercator-2.0
LinkWalker
WebSauger
Teoma (A new SE ready to debut?)
dllbot
architextSpider
OpenFind.Shark
Mc_Kalyan_21
ru_robot

8:35 pm on May 8, 2001 (gmt 0)



Do a Site Search [searchengineworld.com]. There is info on this web site for most (if not all) the spiders on your list.

Jaf

11:36 pm on May 9, 2001 (gmt 0)

10+ Year Member



Most of these are listed on the webbots page I maintain at
[jafsoft.com...]

That page lags behind the discussions here (I only just found this forum), but most of the ones you list are familiar to me

11:39 pm on May 9, 2001 (gmt 0)

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Jaf, welcome to WmW.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month