goodroi - 1:36 pm on Jun 10, 2009 (gmt 0)
Robots.txt is a voluntary protocol. The big search engines honor it and will follow it. Some smaller bots (including scraper bots) will ignore it. If you look in your log file you should be able to see what is behind those clicks.