Mozilla/3.0 NAVIO (dtv0)

Verio - Best.com - and Ravenous

[bobriggs]

This thing - (for lack of a better word) made 1479 successful page requests from 12:50 to 1:04 am last night - less than 15 minutes. (I couldn't count the redirects) Didn't request robots.txt and didn't request images.

UA: Mozilla/3.0 NAVIO (dtv0)
IP: 206.184.139.140
Host lookup: shell9.ba.best.com

rwhois shows it to be a verio ip.

More than 100 pages per minute. And guess what? The site (crawled) only has about 65 pages on it! Multiple requests for the same pages; sometimes 30 times in this 15 minute period.

Now I look at the actual GET requests and find something like:

GET /./directory/./././././page.html

With any number of combinations of /././ ... before the directory and after the directory.

And I see requests like:

GET /././directory (no trailing slash) that are redirects (in that 1479 that did not include the 301 redirects to the correct /directory/ that the server produces)

Anybody else seen it?

[littleman]

I haven't seen it, but thanks for the heads up. I'll be watching for it!