Thanks for the heads-up. I hate these "let users know when your site updates" type scrapers. They contribute nothing to the web and feed off the hard work of webmasters.
robots.txt? YES and appears to have obeyed it, but since it took only default root pages I can't be sure.
keyplyr
9:09 am on Aug 7, 2009 (gmt 0)
Requested robots.tx where it is disallowed, then disobeyed it and hit my index page where it was 403'd by UA. No sense listing it in robots.txt if it doesn't obey it.
