blend27 - 2:42 pm on Nov 13, 2007 (gmt 0)

I have the same, not an issue but, here on our sites. The interesting part is that every page that was visited by this spider all of a sudden starts to rank for its intended LONG Tail. So maybe it is a QC check. Now if we could get the users to use it, this would be Fantastico.

As far as blocking this spider, not taking the Bandwidth into consideration, wouldn’t the entry still appear in the log file, but just with different status code returned? So would this be kind of useless as far as not having the entries in the log file?