Forum Moderators: goodroi
[sitename.com...]
I use mod_rewrite, but this form of URL leaks out to robots through the rss feed. To prevent Googlebot and others from indexing this type of URL, I'd like to block it in my robots.txt file.
My "normal" URLs look more like:
[sitename.com...]
Do I just do this?
User-agent: googlebot
Disallow: /index.php?