AV trying to get it right?

[pshea]

For about the past 2-3 wks, Scooter has been coming everyday after ignoring me for a long, long time. It's getting more 404s than not, but picking up new pages as well. Today it showed up bigtime and looks as though it has gone through everything to see if it's now got it right.

It's been very persistent and not behaving at all like a dying swan. Perhaps it really has big plans to fight back. The rumbles coming my way sure seem like it.

[volatilegx]

I've noticed a resurgence of traffic from AV too. A discussion about the 404 errors is here [webmasterworld.com].

AV traffic is still not up to par with traffic from Google, though.

[rjohara]

Interesting. I've also noticed a distinct rise in AV traffic (i.e. from nothing to almost nothing) in the last three weeks on my academic site. And I also saw the huge number of requests for non-existent pages; for example, all my pages end in .html and I think the AV spider requested every one under the suffix .htm. And loads of erroneously duplicated path components too: instead of correctly asking for /dir/myfile.html it would ask for /dir/dir/myfile.html through the whole site. I thought the poor thing was in its death throes, but maybe there was method in the madness.