Forum Moderators: open

Message Too Old, No Replies

Slurp! looking for really weird stuff

Trying to find real files in non-existent directories

         

fish_eye

11:06 am on Oct 20, 2004 (gmt 0)

10+ Year Member



Over the years I've occassionally seen slurp looking in the wrong directory for a real file (especially for deeplinks where it can skip a rung in the tree), but over the last few hours it's been looking for real files in directories that have never existed anywhere in my site.

For example, I have a file bluewidgets/buyone01.html and it's looking for PinkBananas/buyone01.html

Very odd... anyone seen this before... are they looking to see if I've got multiple domains with duplicate content perhaps?