Forum Moderators: open

Message Too Old, No Replies

Google not following 301's

         

Ajack

3:16 pm on Aug 5, 2002 (gmt 0)

10+ Year Member



Here is my problem:

I had www.mysite.com and www.my-site.com pointing to the same physical website. I had a decent PR, with over 500 pages indexed on www.mysite.com (the other one being there mostly as a convenience, not indexed).

One fine day, Google decided to replace all my www.mysite.com pages by www.my-site.com pages (same URL except for domain), and my PR went freefalling (I guess I lost my inbound links).

To fix this mess, I decided to setup 301 permanant redirction on www.my-site.com. At the following update, all my pages on the www.my-site.com domain were removed, but no pages from www.mysite.com showed up. I was out of Google! I figured the 301 redirection would probably take effect at the following update, but it did not. Google keeps on sending its crawler to www.my-site.com, it keeps on getting a 301, but does not follow it (I can tell from the logs).

It's been 2 updates now, and last week's crawl to the site was no different.

So I am stuck in some sort of limbo, where one site is out and the other one get back in!

Any advice?

Ajack

pageoneresults

3:20 pm on Aug 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Hello Ajack, welcome to Webmaster World. First thing I would do is make sure that the 301 is set up properly. I've seen some that are set up through various providers out there on a shared IP and it was set up incorrectly. There was no URL address in the 301 redirect, it looked like this http //www. and that was it.

Ajack

3:37 pm on Aug 5, 2002 (gmt 0)

10+ Year Member



I am pretty sure the 301's are setup properly.

For one thing, I have noticed that Google follows the 301 for robots.txt, but that is pretty the only file/page for which it does....

Ajack

pageoneresults

3:55 pm on Aug 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Run the URL through Brett's Server Header Check. Go to your Control Panel, then to Plugins and click the link Server Headers. Pay close attention to what is being returned.

Ajack

5:27 pm on Aug 5, 2002 (gmt 0)

10+ Year Member



Nice tool!

And yes, it shows that my 301 is setup correctly.

Ajack

pageoneresults

5:34 pm on Aug 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Okay, one down and who knows how many more to go. Now, run your robots.txt through Brett's Robots Text Validator [searchengineworld.com] and make sure there are no errors.

P.S. Was the full URL of the permanent redirect in the <body></body> of the returned Server Header?

Ajack

6:55 pm on Aug 5, 2002 (gmt 0)

10+ Year Member



I used this tool:
[searchengineworld.com...]

It does not return a <body></body>, but the "Location:" field points to the correct address (www.mysite.com).

If there is a better tool, I will gladly use it to check...

As far as the robots, your other tool said my robots file had no problems.

Thanks for helping

Ajack

pageoneresults

7:18 pm on Aug 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Hmmm, not sure which direction to take at this moment. If you want to Sticky me a URL, I'd be happy to look further to see if there is anything that I can find.

Do either of the two sites show any PR? If not, then there may be a problem such as a duplicate content issue, not sure. You said...

> One fine day, Google decided to replace all my www.mysite.com pages by www.my-site.com pages.

How did Google get to the my-site.com domain? Is it possible that someone linked to it purposely to cause the problems you are now faced with? We're you promoting both domains? And, what type of redirect was set up for my-site.com before the 301 redirect went into place?

Ajack

4:42 pm on Aug 7, 2002 (gmt 0)

10+ Year Member



Well I just read in the Google help pages that it make take 6-8 weeks for Google to handle the 301 redirects, and I maybe just be still at the end of that range.

I also noticed that Google crawled my site yesterday, and went through a bunch of correct URL's (mysite.com), but still a majority of incorrect ones (my-site.com).

So maybe Googlebot was just slow to understand 301's?

The other options that I am considering are:
1) Use Google's site removal form to force removal of my-site.com from the index
2) Redirect my-site.com somewhere else, where the crawler would find a META REFRESH back to mysite.com

Any optinons on these tow methods?

Ajack

jdMorgan

4:19 am on Aug 8, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ajack,

Since Google is now crawling your "correct" domain and seeing the 301s, just let it do its thing.
I wouldn't touch anything now - You've got everything in place, and if someone does try to use your
"wrong domain", they'll get 301'ed over to the right one, and so won't bookmark or link to the wrong
one. Leave everything you've got in place, and look forward to the next update! Then, use the
Google Toolbar's backwards link function (or just do a regular search for links) and find out where
the Googlebot picked up the "my-site" domain name and get that corrected.

Best,
Jim