Its been bought up elsewhere that Google does not like dynamic URL's , IE: ones with '?' in them? The reasoning is that Googlebot will get bogged down with too many links - which is understandable. So , how do you stop the bot from only scanning certain 'surface' pages such as with a PHP bulletin board like PHPBB2? I have tried to use robots.txt to individially reference certain files, but is there an easier way without disallowing the entire directory where the bulletin board resides?
