dstiles - 6:17 pm on Aug 14, 2012 (gmt 0)
This has been around for a few months at least but the first time (I think!) I've noticed it. It seems innocuous until you read their remit.
UA: bl.uk_lddc_bot/3.1.1 (+http://www.bl.uk/aboutus/stratpolprog/digi/domresproj/index.html)
(Another IP in the 126.96.36.199/24 range has also made a scrape attempt recently.)
The bot info page linked to in the UA includes:
"The content harvested at this time will not be made available."
"This work is undertaken in anticipation of forthcoming Legal Deposit regulations that will make it the Library’s statutory responsibility to collect, preserve and provide long-term access to the UK’s online intellectual and cultural heritage."
The page does include opt-out and complaints options.
My worry would be: who will ultimately be able to view the details and how; and can it be easily scraped from them.