Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Googlebot crawling strange "?ref=something.com" attached to my pages


flicky - 5:29 am on Feb 22, 2010 (gmt 0)


ah, sorry... thanks Tedster

One other strange thing I just noticed in my log file. Even though I'm 301 redirecting domain.com to www.domain.com, googlebot continues to try to crawl the domain.com in "some" cases. I never thought I'd have to set the "preferred domain" setting in GWT since I have been 301 redirecting for years. But I just did it. When I went to do it, it said... "you need to verify ownership of "domain.com". So I added it to GWT. So I set that one to "www.domain.com" as well. Hopefully that does the trick.

The last anomoly I saw in my log file is that googlebot tries to access many of my pages with a ? at the end like this...

page1.html?
page2.html?

Those aren't redirected... probably my mistake... I was only redirecting "?ref" ... they are crawled with no problem. Is google smart enough to know the difference between page1.html? and page1.html? Or is that a duplicate content situation? I suppose I should redirect anything with a "?"

thanks... so many issues!

marc


Thread source:: http://www.webmasterworld.com/google/4084570.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com