i have seen this spider from lycos way back, but used to only pick up the index page.
keywordbuys
9:27 pm on Mar 13, 2002 (gmt 0)
Lycos uses the mod spider to crawl pages in the new insite select PFI program.
brotherhood of LAN
9:35 pm on Mar 13, 2002 (gmt 0)
ummm...would there be any link between this and the Hotbot thread?
Brett_Tabke
9:39 pm on Mar 13, 2002 (gmt 0)
hmmmm. I can find mod_spider hits on all kinds of pages without paying for them.
keywordbuys
10:50 pm on Mar 13, 2002 (gmt 0)
I was just stating my experience, I paid for Lycos to index a page and that's the spider they used. I've never seen it before, it may just be a new build.
MarkHutch
12:06 am on Mar 14, 2002 (gmt 0)
Brett, maybe someone paid to have their site spidered and the Lycos spider found your site via that link.
(edited by: MarkHutch at 6:58 pm (utc) on Mar. 26, 2002)
Key_Master
12:17 am on Mar 14, 2002 (gmt 0)
>>>hmmmm. I can find mod_spider hits on all kinds of pages without paying for them.
Me too, for quite some time.
Son_House
2:03 am on Mar 14, 2002 (gmt 0)
>>>hmmmm. I can find mod_spider hits on all kinds of pages without paying for them.
Me too.
Air
2:37 am on Mar 14, 2002 (gmt 0)
>>>hmmmm. I can find mod_spider hits on all kinds of pages without paying for them.
Same here, going back awhile
engine
9:12 am on Mar 27, 2002 (gmt 0)
Interesting - it turned up for a new domain without specific submission. Resolves to: Lycos, Inc. (NETBLK-NETBLK-LYCOS-1) 400-2 Totten Pond Road Waltham, MA 02451 US
