homepage Welcome to WebmasterWorld Guest from 54.161.247.22
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

    
Getting crawled by Lycos_Spider
Anyone know anything about this one?
creep




msg:220289
 8:39 pm on Sep 20, 2001 (gmt 0)

5 visits today and 7 yesterday by something that is called Lycos_Spider in my stats. Anyone shed any light on this..just lycos's spider ..I was under the impression that fast handled Lycos..??

 

IanTurner




msg:220290
 8:46 pm on Sep 20, 2001 (gmt 0)

No Lycos have their own spider too, seems to be historical. Always useful to submit to Lycos.com just in case :)

starec




msg:220291
 7:31 am on Sep 21, 2001 (gmt 0)

Lycos probably tries to keep its spider in a good shape in case fast goes under...

Marcia




msg:220292
 7:38 am on Sep 21, 2001 (gmt 0)

I routinely submit to FAST and Lycos both. The Lycos spider appears within hours, for only the pages submitted, goes no further at this visit.

caine




msg:220293
 9:11 am on Sep 21, 2001 (gmt 0)

there has been many a debate about whether there is any real beneficial effect of sub-ing to lycos, but the jury is still out on that one.

Ian, i like the idea - seems feasible.

IanTurner




msg:220294
 9:51 am on Sep 21, 2001 (gmt 0)

As starec says Lycos is probably keeping the spider in case Fast goes under. This means that if Lycos drops Fast for any reason they will probably return to their own database and if your site is in their database you could get the drop on sites that aren't.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved