Digg's UA

[incrediBILL]

Large popular web site using default library UA, nice, real nice:
"PEAR HTTP_Request class ( [pear.php.net...] )"

Digg, Inc. EQUINIX-ED-DIGG-1 (NET-64-191-203-0-1)
64.191.203.0 - 64.191.203.255

[incrediBILL]

Just in case someone reads this that can fix the problem here's an example of the code you need:

$request->addHeader('User-Agent', 'Digg');

[Samizdata]

+1 Digg for the above post.

...

[jdMorgan]

Since we may only get one shot at this, let's help them do it right:

$request->addHeader('User-Agent', 'Digg/1.0; (+http://digg.com/diggbot.html)'); 
$request->addHeader('From', '[e-mail]');

The /diggbot.html URL must resolve to an HTML page that explains the purpose of the crawl (or fetch) and the intended usage of data so collected, and [e-mail] must resolve to support for Webmasters experiencing problems with the user-agent's activities.

Since I'm one who gripes about invalid and uninformative user-agent strings, I thought I'd better say something now... :)

I'm not sure if my literal parentheses need escaping in the quoted string...

Jim

[coopster]

I'm not sure if my literal parentheses need escaping in the quoted string...

Nope. Good as is.