Welcome to WebmasterWorld Guest from 54.146.248.111

Forum Moderators: open

Message Too Old, No Replies

Getting crawled by Lycos_Spider

Anyone know anything about this one?

     

creep

8:39 pm on Sep 20, 2001 (gmt 0)

10+ Year Member



5 visits today and 7 yesterday by something that is called Lycos_Spider in my stats. Anyone shed any light on this..just lycos's spider ..I was under the impression that fast handled Lycos..??

IanTurner

8:46 pm on Sep 20, 2001 (gmt 0)

WebmasterWorld Administrator ianturner is a WebmasterWorld Top Contributor of All Time 10+ Year Member



No Lycos have their own spider too, seems to be historical. Always useful to submit to Lycos.com just in case :)

starec

7:31 am on Sep 21, 2001 (gmt 0)

10+ Year Member



Lycos probably tries to keep its spider in a good shape in case fast goes under...

Marcia

7:38 am on Sep 21, 2001 (gmt 0)

WebmasterWorld Senior Member marcia is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I routinely submit to FAST and Lycos both. The Lycos spider appears within hours, for only the pages submitted, goes no further at this visit.

caine

9:11 am on Sep 21, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



there has been many a debate about whether there is any real beneficial effect of sub-ing to lycos, but the jury is still out on that one.

Ian, i like the idea - seems feasible.

IanTurner

9:51 am on Sep 21, 2001 (gmt 0)

WebmasterWorld Administrator ianturner is a WebmasterWorld Top Contributor of All Time 10+ Year Member



As starec says Lycos is probably keeping the spider in case Fast goes under. This means that if Lycos drops Fast for any reason they will probably return to their own database and if your site is in their database you could get the drop on sites that aren't.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month