The_Contractor - 5:40 pm on Jul 15, 2004 (gmt 0)

If I offended anyone I didn't mean too. I agree with jdMorgan and I am not out to attack anyone. I have been trying to block the dumbot for a while now because all that was there in the UA was a link to a "basically" blank page.

If you want to be taken seriously and are working on a project indexing sites - the more info you can give on who you are and why you are crawling the better. There are enough site scrapers/downloaders out there where if someone doesn't say what they are doing and who they are - I block them instantly (at least I try with robots.txt and .htaccess).