homepage Welcome to WebmasterWorld Guest from 54.197.183.230
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
301 redirects and robots.txt
lpiracing



 
Msg#: 4057545 posted 12:13 am on Jan 10, 2010 (gmt 0)

Our site has changed it's URL structure from www.example.com/pc to www.example.com/store/pc.

I know it's not ideal to add another category, but in order to be able to easily upgrade our cart system we need to keep their default URL structure. We did major mods to remove the store directory in the old system, and never really did get everything working right.

So I 301 redirected the www.example.com/pc pages to the new www.example.com/racing-parts/pc structure. It appears Google ranks all the old urls higher than the new ones, I suspect due to the extra directory away from the root.

So when should I add a dis-allow the www.example.com/pc to the robots.txt to get rid of the old URL's.

Any other thoughts on how to get Google to rank the new pages over the old ones?

We have a sitemap, etc...

 

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 4057545 posted 1:42 am on Jan 10, 2010 (gmt 0)

You should never need to add it. As Google finds the 301 redirects those URLs will naturally drop from the index.

Google has been a bit chaotic in recent weeks, doing some back-end changes to prepare for their new infrastructure. So lots of general spidering and housekeeping is behind schedule. As long as the visitor who clicks on the old URL is getting 301 redirected, you have no worries.

seolearner



 
Msg#: 4057545 posted 4:50 am on Jan 10, 2010 (gmt 0)

Yes, I have also tried 301 redirect. I needed to change the file name. So I set 301 to new file name. Until Google crawled my old URL again, I was getting copied content warning message in WMT. But as soon as my old URL was crawled again, the old URL was dropped from the index and also the warning message in WMT disappeared. So wait until your old URLs crawled again.

Robert Charlton

WebmasterWorld Administrator robert_charlton us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4057545 posted 6:51 am on Jan 10, 2010 (gmt 0)

So when should I add a dis-allow the www.example.com/pc to the robots.txt to get rid of the old URL's.

If you had added the disallow for the old urls, in fact, Google most likely would have been slower about dropping them, as Googlebot wouldn't have been able to crawl them and discover the 301s.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved