pandora crawler

[OZmike]

<HTTP_USER_AGENT>
Mozilla/5.0 (compatible; heritrix/1.5.x +http://pandora.nla.gov.au/crawl.html)
</HTTP_USER_AGENT>

Our site got crawled by this crawler run by the government here in Australia, rather intrusive I think in the fact that they copy all the site including javasripts and images and then re publish the data. I have banned the ip address and changed my robots txt file to stop them from ever doing it again, and have been advised by the webmaster that we will be removed from their database, however I am concerned that organisations such as these are effectively plundering peoples intellectual property at will, what can be done to bring this to a halt?

[nzmatt]

>what can be done to bring this to a halt?

Talk to your local opposition party member.

[OZmike]

yes, fine will do our local member is the opposition leader in parliament so will give it a try, just cant get over the arrogance of the people snatching my data for a bunch of academics to go over and use my content.

thanks