- - Google
- -- Google SEO News and Discussion
- ---- 301 redirects and robots.txt
Robert_Charlton - 6:51 am on Jan 10, 2010 (gmt 0)
|So when should I add a dis-allow the www.example.com/pc to the robots.txt to get rid of the old URL's. |
If you had added the disallow for the old urls, in fact, Google most likely would have been slower about dropping them, as Googlebot wouldn't have been able to crawl them and discover the 301s.
Thread source: http://www.webmasterworld.com/google/4057545.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com