Welcome to WebmasterWorld Guest from 22.214.171.124 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe to WebmasterWorld
mod_rewrite and Google using mod_rewrite with safety jorje29 msg:768065 3:42 am on Jun 23, 2005 (gmt 0) I've made some SEO changes in my website and now, I'm using mod_rewrite. Do I've to remove all dynamic indexed pages from Google?
if yes, is this the right code for robots.txt file :
thanx in advance.
Clint msg:768066 9:55 am on Jun 23, 2005 (gmt 0)
User-agent: Googlebot Disallow: /FoldernameOrPagename/WhateverIfAny
taps msg:768067 10:31 am on Jun 23, 2005 (gmt 0)
jorje: I think that should work. This is indeed what Google recommends to remove dynamic content.
However: I'd be careful. You'll have more control if you name the files explicitly (sp?). This might be a little more work but a lot more control:
Disallow: /show.php Disallow: /otherdynamicthing.php ... JuniorOptimizer msg:768068 10:50 am on Jun 23, 2005 (gmt 0)
I did this and it did very poorly.
I disallowed all dynamic content for several VBulletins after I did a rewrite. Google had a hard time ranking anything. When I let them back in, they were able to do a much better job of ranking the pages.
vicyankees msg:768069 4:38 am on Jun 24, 2005 (gmt 0)
my site uses?src=___ on many urls and google and other search engines are seeing these as different pages with the same content which can lead to disaster. is it possible to do a mod_rewrite with wildcards on the src marker?