Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: goodroi
Will this stop googlebot from requesting all dynamic data? The only way to test this is to have a high ranked PR. And I don't feel testing it on a production enviroment when I have the high PR because who knows, it could drop the site from the index for one or two months.
If I'm reading this statement correctly from Google's website, then the above method will prevent Google from indexing dynamic content.
> In addition, Googlebot understands some extensions to the robots.txt standard: Disallow patterns may include * to match any sequence of characters, and patterns may end in $ to indicate that the $ must match the end of a name. For example, to prevent Googlebot from crawling files that end in gif, you may use the following robots.txt entry:
<edit> Ah, never mind. Now that I review this again, I see what you are trying to do...