indyank - 3:46 am on Jul 20, 2011 (gmt 0)

creeking, that wouldn't work.You will have to de index them before blocking and for the kind of test he is doing, it isn't an option at all. The bots will still have to know there are pages on such topics.