Welcome to WebmasterWorld Guest from 184.108.40.206 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
Getting crawled by Lycos_Spider Anyone know anything about this one? creep msg:220289 8:39 pm on Sep 20, 2001 (gmt 0) 5 visits today and 7 yesterday by something that is called Lycos_Spider in my stats. Anyone shed any light on this..just lycos's spider ..I was under the impression that fast handled Lycos..??
IanTurner msg:220290 8:46 pm on Sep 20, 2001 (gmt 0)
No Lycos have their own spider too, seems to be historical. Always useful to submit to Lycos.com just in case :) starec msg:220291 7:31 am on Sep 21, 2001 (gmt 0)
Lycos probably tries to keep its spider in a good shape in case fast goes under... Marcia msg:220292 7:38 am on Sep 21, 2001 (gmt 0)
I routinely submit to FAST and Lycos both. The Lycos spider appears within hours, for only the pages submitted, goes no further at this visit. caine msg:220293 9:11 am on Sep 21, 2001 (gmt 0)
there has been many a debate about whether there is any real beneficial effect of sub-ing to lycos, but the jury is still out on that one.
Ian, i like the idea - seems feasible.
IanTurner msg:220294 9:51 am on Sep 21, 2001 (gmt 0)
As starec says Lycos is probably keeping the spider in case Fast goes under. This means that if Lycos drops Fast for any reason they will probably return to their own database and if your site is in their database you could get the drop on sites that aren't.