Forum Moderators: open

Message Too Old, No Replies

Slurp won't stop 404ing

Anyone else experienced this?

         

The Cricketer

11:06 am on Mar 23, 2004 (gmt 0)

10+ Year Member



I have been getting loads of 404 errors to my website and only the other day realised that they were all emanating from Slurp.

The reason for these errors was that it was inventing folders that had never been on our website and adding current files onto the end of the folders.

eg. here are all the made up folders
operdisp/info.asp
Online_publications/news/products.htm
zhuangindex/downloads.htm
hetero-ag/downloads.htm
breech.re/troubleshooting/info.asp

when searching on google
hetero-ag seems to have sexual meaning
breech.re seems to have hacking meaning

66.196.90.16 - - [03/Mar/2004:21:55:00 +0000] "GET /hetero-ag/downloads.htm HTTP/1.0" 404 296 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http ://help.yahoo.com/help/us/ysearch/slurp)"

IP is Inktomi Corporation on yahoo.com nameservers.

Does anyone have any views?

highman

11:44 am on Mar 23, 2004 (gmt 0)

10+ Year Member



Yes this is an old problem with Slurp - do a search here and you will find similar complaints

webmktg

12:53 pm on Mar 23, 2004 (gmt 0)

10+ Year Member



I'm experiencing the same problem with my website. Have you got any of your pages listed in Yahoo?

The Cricketer

2:42 pm on Mar 23, 2004 (gmt 0)

10+ Year Member



Yep I believe that all of my pages are listed, but then the site is pretty old.