What is this spider? It can't be an Altavista bot, as it tried to access non-existing pages of my site (did something like "GET /qnevadrhmmimthhfunbl.html" and "GET /rceuikatermhbkrltsas.html").
fiestagirl
8:13 pm on Sep 27, 2002 (gmt 0)
It probably was AV. They will check to make sure that you are not redirecting those visits to the home page or elsewhere. While it might seem sensible to do that, say if a customer typoed and you don't want them to just leave and give up you might be tempted. This will only confuse spiders - possibly catching them in an endless loop of requests.
<added> I might mention that Inktomi has been checking this also. I've seen requests for www.mydomain.com/...
