Having lots of dynamic pages, made up to look static...

but more or less with the same content, would it be a problem?

[martin]

I have lots of generated pages, that are made up to look static. The content is basicly the same (some minor changes), eg. like the post comment form here.

I have a meta robots=noindex,follow - is this enough or should I disallow it from robots.txt to make sure it doesn't make something wrong?

[taxpod]

martin,

Not really sure what you are asking. You have a bunch of dynamic pages and the URLs have no ? in them and the URLs do not look like the typical dunamic URL. That's cool. But why would you have no index, follow on them? Don't you want them spidered?

[Marcia]

martin, are you saying you're ending up with page.php?.... and page.htm both, with almost identical content, and that's why you're concerned about dupllicate content, because of both being indexed?

You might want to do a site search for mod_rewrite where these issues are discussed in detail.

[martin]

Well, I'm using exactly mod_rewrite.

I have for example:

/comment/pagename1
/comment/pagename2
...

So these pages all have the same content but the action handler for the form. Is it right to leave bots index them or will I need to prevent them from doing it?

[MHes]

Hi
Having them as .html is good, but unless at least 20% of the content is different for each page, then I would worry about duplicate content. I would use the robots.txt to stop the spider

[martin]

Thank you MHes, I didn't know if spiders hate that.