Yahoo is spidering nonexistent pages. For example: "http://www.mysite.com/?/garbage/foo/garbage/" I don't think their bot pulled this out of a hat. It looks like someone wants to make it look like I'm running duplicate content since the server returns the content for "http://www.mysite.com/". I'm not sure if I should be asking this in the Apache forum, but can anyone tell me how to fix this?
Durham_e
3:24 am on Nov 9, 2004 (gmt 0)
I asked this question a few months ago (it was also simultaneously asked in the tracking forum)
Answer: Don't worry Yahoo does this from time to time for no apparent reason.
It is however kind of freaky when it happens.
cabowabo
3:40 am on Nov 9, 2004 (gmt 0)
We've tried everything we can think of and we can't find a solution. If someone has one, it would be much appreciated to post.
CaboWabo
SlowMove
4:07 am on Nov 9, 2004 (gmt 0)
The thing that bothers me is that I brought up one of these pages in IE with the Google Toolbar installed, and I'm running adsense on the home page. So, Google, which seems not to like duplicate content, now has the bogus URL. This leads me to the paranoid thought that Y! might be doing this to degrade Google SERPS. Is that a crazy thought? Are big companies above playing this kind of game?
