Forum Moderators: open
The robots exclusion standard isn't to clear on this, but i'm wondering :
# robots.txt
User-agent: *
Disallow: /forum.php?action=post
will that work?
Or will googlebot ignore everything after the ? and not index forum.php at all?
I'm only interested in googlebot, as the results may differ between search engines.
/forum.php?action=post
means it will not crawl
/forum.php?action=post
/forum.php?action=post&what=iswhat
/forum.php?action=postoffice
but it will crawl
/forum.php?what=iswhat&action=post
remember it is a matching game. ;)
GoogleBot love dynamics pages, they are delicious!