Page is a not externally linkable
blend27 - 6:27 pm on Mar 29, 2005 (gmt 0)
you give me a user agent string and IP, that you use when scraping the content from the site I have and I will make sure to add it to my robots.txt file to disallow it, just for you. but that is not what you would like to do, ah?
scraperrob -- The Robots.Txt standard says that if you are not dissallowed then you can scrape all you want.