Human or Bot?

[Mokita]

Took one page plus all normal supporting files with this UA:

"Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"

Then downloaded all linked pages using this UA:

"Squid-Prefetch"

I thought that Squid is executed server-side - do browsers somehow use it too?

[wilderness]

[deckle.co.za...]

[Mokita]

Thanks for the link Don - but I'm still unclear about how it works.

I'm pretty sure this visitor was a bot. One came from the same Australian ISP about two days ago using a Java UA, and ate 403s. I suspect it is the same one trying a new tack.

The ISP seems to have an open proxy, however I can't block their CIDR as I'd be blocking humans too.

I've banned the Squid UA in htaccess, but as they seem rather determined, I'm sure they'll try some different.

[wilderness]

Mokita,
Is it possible to block the IP utilizing a portion of UA?
Perhaps even a combination of two successive portions?
EX:

RewriteCond %{HTTP_USER_AGENT} InfoPath
RewriteCond %{REMOTE_ADDR} ^123\.456\.789\.
RewriteRule .* - [F]

Don

[wilderness]

Here's some more Squid/browser reading explaining the utilizing pf proxies.

[wiki.squid-cache.org...]

[incrediBILL]

Squid-Prefetch is always associated with a proxy server.

However, on my server Squid-Prefetch gets an error page so cache THAT you pre-loading pains in the ...