Forum Moderators: open

Message Too Old, No Replies

Inkitomi spidering my site but .....

         

sebans

6:32 am on Jan 27, 2004 (gmt 0)



inkitomi slurp is spidering my site but always calling 2 files I don't have anymore:

/index.php
/search.php

and always getting a NOT FOUND error.

is this a problem? Should I do something?

thanks in advance

sebans

pixel_juice

7:32 pm on Jan 27, 2004 (gmt 0)

10+ Year Member



There's been a few reports of Slurp requesting 404s that have been gone for a while, and other erratic activity. I don't think you need to be very concerned.

If the pages you mention have moved or changed names, you might try redirecting them with a 301 to the new location to try and help Slurp along a little :)

sebans

9:44 am on Jan 28, 2004 (gmt 0)




thanks pixel_juice

I changed name to existing files to avoid the error message. But still I don't understand why Inkitomi is on my site so often?

sebans

pixel_juice

8:14 pm on Jan 28, 2004 (gmt 0)

10+ Year Member



>>But still I don't understand why Inkitomi is on my site so often?

From my experience Slurp spiders very aggressively, although its activity is not often reflected in Inktomi results.

>>I changed name to existing files to avoid the error message

If you mean you renamed the new files to the names above, you risk the same thing happening with the newer pages - redirecting is usually the best option ;)