Welcome to WebmasterWorld Guest from 54.147.189.54

Message Too Old, No Replies

How to redirect bot from subdirectory to root directory

     
3:24 am on Oct 8, 2010 (gmt 0)

New User

10+ Year Member

joined:Oct 16, 2005
posts: 35
votes: 0


i recently created a new site and moved my old site to its subdirectory -- www.site.com/version1 .

- how can i make google redirect from all www.site.com/version1 to the root directory www.site.com so all traffic will be redirected to the new site. ?

Thanks in advance.
4:27 am on Oct 8, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


I'm a bit confused - why did you give the old domain new urls if you want them redirected anyway? I assume the new version of your new site uses new URLs. Wouldn't it be better to redirect the old URLs to the new URLs and not even have the old site live at all?
4:49 am on Oct 8, 2010 (gmt 0)

New User

10+ Year Member

joined:Oct 16, 2005
posts: 35
votes: 0


i moved it to archived the old site. now google is still crawling the old site. I also noticed google is crawling more the old site than the new site. Could it be possible to redirect google so all traffic will go to the new site? how?

thanks for the reply.
5:46 am on Oct 8, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


No one has linked to the archived site in its new location, right? If that's true, I'd just disallow that subdirectory in the robots.txt file. That's better than a redirect.

With a redirect, googlebot still keeps checking the URL and those checks use up part of your crawl budget. But if you disallow the subdirectory in robots.txt, then that pretty much ends googlebot requesting those URLs and frees crawl budget to ask for your new ones.
6:24 am on Oct 8, 2010 (gmt 0)

New User

10+ Year Member

joined:Oct 16, 2005
posts: 35
votes: 0


is that the best approach to also increase craw and index rate of the new site?

so ill just put a robot.txt in the old directory?

is this right?

User-agent: *
Disallow: /
6:45 am on Oct 8, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


Not exactly. You put a robots.txt file in the ROOT directory:

User-agent: *
Disallow: /version1
6:50 am on Oct 8, 2010 (gmt 0)

New User

10+ Year Member

joined:Oct 16, 2005
posts: 35
votes: 0


ok. thanks!

will do what you advice hopefully it'll increase web index in my site.