Welcome to WebmasterWorld Guest from 54.234.244.30

Forum Moderators: open

Message Too Old, No Replies

Getting crawled by Lycos_Spider

Anyone know anything about this one?

     
8:39 pm on Sep 20, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:July 26, 2001
posts:139
votes: 0


5 visits today and 7 yesterday by something that is called Lycos_Spider in my stats. Anyone shed any light on this..just lycos's spider ..I was under the impression that fast handled Lycos..??
8:46 pm on Sept 20, 2001 (gmt 0)

Moderator from GB 

WebmasterWorld Administrator ianturner is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:July 19, 2001
posts:3452
votes: 10


No Lycos have their own spider too, seems to be historical. Always useful to submit to Lycos.com just in case :)
7:31 am on Sept 21, 2001 (gmt 0)

Preferred Member

10+ Year Member

joined:Feb 17, 2001
posts:409
votes: 0


Lycos probably tries to keep its spider in a good shape in case fast goes under...
7:38 am on Sept 21, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member marcia is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Sept 29, 2000
posts:12095
votes: 0


I routinely submit to FAST and Lycos both. The Lycos spider appears within hours, for only the pages submitted, goes no further at this visit.
9:11 am on Sept 21, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 21, 2001
posts:2488
votes: 0


there has been many a debate about whether there is any real beneficial effect of sub-ing to lycos, but the jury is still out on that one.

Ian, i like the idea - seems feasible.

9:51 am on Sept 21, 2001 (gmt 0)

Moderator from GB 

WebmasterWorld Administrator ianturner is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:July 19, 2001
posts:3452
votes: 10


As starec says Lycos is probably keeping the spider in case Fast goes under. This means that if Lycos drops Fast for any reason they will probably return to their own database and if your site is in their database you could get the drop on sites that aren't.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members