Forum Moderators: mack
http://www.example.com/apple/apple/apple/apple/orange.htm
There is, in fact, a page like this:
http://www.example.com/apple/orange.htm
At first I thought it was some kind of misguided hack attempt, but the raw logs showed it was only the friendly MSNBot. This bot (no problem with Googlebot or Slurp) seems to have gone a bit nutty, asking for various numbers of non-existent folders. I.e., it looked for the same page with two /apple/ folders, three, four, etc. up to six or so.
Anyone know what can trigger this kind of behavior? The links are coded as relative, but I don't see any way that the bot could get fed recursively deeper false directories. Or should I just chalk it up to a random bot error and not worry about it if it doesn't happen again?