Forum Moderators: open

Message Too Old, No Replies

Looksmart Spidering old index file?

Looksmart Spidering

         

tuanku

1:21 am on Dec 2, 2002 (gmt 0)



Hi,

I am new here. I've been busy reading posts here (Great Forum!) and now I've got the chance to ask question. I hope I am posting this to right subforum.

Lately I am having quite a few error 404 file doesn't exist triggered by Looksmart [209.249.67.107] spidering/indexing? my website. I've located the problem and corrected it. I am expecting the error would stop immediately but it doesn't.

Could it be Looksmart is keeping old index file in its database and then spidering/indexing based on that old file.?

Zul Zul

Brett_Tabke

3:22 pm on Dec 3, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



What's the user agent name? Wisenut? Then it was Wisenut spidering from a Looksmart domain.

tuanku

5:15 pm on Dec 3, 2002 (gmt 0)



Yes, (wn.zyborg@looksmart.net; [WISEnutbot.com)...]

But I don't quite understand your point. Could you explain a bit. Does that mean there is nothing much I can do for now?

thanks