| 4:27 am on Oct 8, 2010 (gmt 0)|
I'm a bit confused - why did you give the old domain new urls if you want them redirected anyway? I assume the new version of your new site uses new URLs. Wouldn't it be better to redirect the old URLs to the new URLs and not even have the old site live at all?
| 4:49 am on Oct 8, 2010 (gmt 0)|
i moved it to archived the old site. now google is still crawling the old site. I also noticed google is crawling more the old site than the new site. Could it be possible to redirect google so all traffic will go to the new site? how?
thanks for the reply.
| 5:46 am on Oct 8, 2010 (gmt 0)|
No one has linked to the archived site in its new location, right? If that's true, I'd just disallow that subdirectory in the robots.txt file. That's better than a redirect.
With a redirect, googlebot still keeps checking the URL and those checks use up part of your crawl budget. But if you disallow the subdirectory in robots.txt, then that pretty much ends googlebot requesting those URLs and frees crawl budget to ask for your new ones.
| 6:24 am on Oct 8, 2010 (gmt 0)|
is that the best approach to also increase craw and index rate of the new site?
so ill just put a robot.txt in the old directory?
is this right?
| 6:45 am on Oct 8, 2010 (gmt 0)|
Not exactly. You put a robots.txt file in the ROOT directory:
| 6:50 am on Oct 8, 2010 (gmt 0)|
will do what you advice hopefully it'll increase web index in my site.