Jakarta HTTP Client/1.0

[keyplyr]

Any evidence whether this UA is used for scraping? I see it coming from many IP addresses, some corporate and some ISPs, hard to tell it's purpose other than link checking.

[wilderness]

There's tons of old threads on this in the archives
[google.com...]

This seems to be the most relavant

[jakarta.apache.org...]

[jdMorgan]

Don's slackin' tonight... :)

It's not a browser.
It doesn't declare itself as a "useful" 'bot.

We hope you enjoy these most delicious 403's, Mr. Jakarta, sir...

Jim

[keyplyr]

This seems to be the most relavant

[jakarta.apache.org...]
Thanks Don, I know what it is having read that page many times over the years.

I know of one software company that uses it to check link validity in it's directory for school libraries, so I've allowed it in the past. Lately it came from an IP address assigned to IBM, taking a couple dozen pages as a bot would.

[wilderness]

IP address assigned to IBM

keyplr,
"IBM" there's an "icon" that potentially sends shivers of conspiracy to anyone over the age of 40 ;)

For the longest time they were crawling from that range in NJ with a 3rd party purpose to support unknown (at least to webmasters) clients.
For the most part their reason for crawling remains a mystery today.

Don