scooterdude - 4:28 pm on Jan 3, 2013 (gmt 0)

er no

I am familiar with the noindex route, my issue is to prevent spiders/robots from crawling potentially vast numbers of urls which i don't want indexed,

whilst allowing people to use those urls

bot activity can get so intense, that a dedicated server which i got to resolve the issue would be flattened for hours, and the bots , turn out to be gbot, bingbot, baidu , yandex, spiders I have no intention of banning

My fear is the cloaking label, and knowing g, theyd not even tell one that that was their thinking, one would have to read their "mind/penalty" :)