homepage Welcome to WebmasterWorld Guest from 54.167.10.244
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

This 211 message thread spans 8 pages: < < 211 ( 1 2 3 4 5 6 [7] 8 > >     
"UK results only" - site: command shows index page missing
A problem in Google UK (UK results only filter) affects non .co.uk domains
fishfinger




msg:3051239
 8:03 am on Aug 18, 2006 (gmt 0)

Except on these UK datacentres

64.233.183.107
64.233.187.99
66.249.85.107

If you do a site: search using Google UK's 'UK results only', the index pages of ten .com domains and three .net domains (out of 65 that I manage) are not listed.

1) All sites hosted in the UK across 4 different servers in 3 different DCs
2) No link exchanges, very little outward linking, no excessive inward linking. No inter-linking. These are not directories, MFA, affiliate. They are contact/services offered websites for UK companies and sole traders. Some are dynamic, some static. Size from under ten to under one hundred pages.
3) No canonical issues, no dupe content issues, no over-optimisation. I use the same techniques and links for all my sites. Number of affected sites has not grown since this problem was spotted. Unaffected sites re-cached this week.
4) Internal pages all listed AND RANKING for their terms.

Would other UK based webmasters like to share their experiences? Perhaps we can collectively contact Google and refer them to this thread.

 

Pirates




msg:3191550
 2:47 am on Dec 18, 2006 (gmt 0)

Google Refuse to Recognise Xfactor Winner.....

I am an Xfactor viewer and yep great Leona won and Ray was great as well. Shame when I search "itv.com" that google have removed there homepage from uk results. Had to go on yahoo to find itv result in uk listings. Whatever is going on at google they are looking very silly right now. MSN and Yahoo had no problem listing itv.com as a uk domain and headlined the new Xfactor winner with a download to the single.

Google howether ommited itv.com homepage from uk results on some algo I doubt even they themselves understand.

[edited by: Pirates at 2:52 am (utc) on Dec. 18, 2006]

Pirates




msg:3191602
 4:09 am on Dec 18, 2006 (gmt 0)

Ok 8 million people voted on X factor and that ment millions of searches on itv.com. The fact this site's homepage was excluded from uk results on google shows to me an attempt by google to hijack the .com domain for the usa. And if its allowed to continue the usa will take .com as its own domain which is not what the internet is about or .com is about.

I believe google are on a deliberate path to hijack .com domains from the rest of the world instead of setting up and supporting a regional domain for the states. By gaining dot com domains google would give the states a worldwide advantage. Its interesting that yahoo and msn are not following this path though and are supporting regional .com listings. Don't be evil - google are looking to me the most evil thing out there.

tedster




msg:3191625
 4:53 am on Dec 18, 2006 (gmt 0)

Whatever is going on, I can't see it as any kind of conspiracy to hijack a TLD for the US - besides, where's the gain for Google in that?

It's got to be some kind of unintended consequence, some poor assumption in the filtering code, I think. Some sites in this thread report an "in and out and in again" kind of cycle. That shows me that Google knows they don't have it right, and your ITV example is certainly a glaring one.

With code as complex as google's, unintended consequences must haunt them constantly. SERPs are the end result of a large team's work and that can be very difficult to coordinate.

fishfinger




msg:3191782
 9:28 am on Dec 18, 2006 (gmt 0)

Do you use an ROS link back to you as the developer from your client sites?

No, on one page of each site only. Links are spread between three pages on our site. All three are ranking presently. Even when the home page is dumped, the other two rank.

mcdermc




msg:3191783
 9:29 am on Dec 18, 2006 (gmt 0)

Pirates @ 11:36 pm on Dec 2, 2006 "So I believe its to do with onsite problems. I have a strong theory about what it might be. Currently advising a client on neccessary changes. I'll promise to keep you posted.... and if I am correct post the cure."

Pirates @ 12:54 am on Dec 3, 2006 "I think I have an answer but posting it on forum may help people I don't want to so will intrust my solution if it works to Tedster as he hates spammers as much as I do."

Pirates @ 2:47 am on Dec. 18, 2006 "Whatever is going on at google they are looking very silly right now. Google howether ommited itv.com homepage from uk results on some algo I doubt even they themselves understand."

Pirates @ 4:09 am on Dec 18, 2006 "I believe google are on a deliberate path to hijack .com domains from the rest of the world..."

....and the winner is........?

Wilburforce




msg:3191814
 10:09 am on Dec 18, 2006 (gmt 0)

Clearly the cause of problem - as several of us have been saying for a long time now - is at Google's end of the microscope.

I recently looked at a friend's (UK .com) site which - from here - seemed to be exhibiting the same symptoms. However, I ususally use a (US-based) proxy. His index page is missing when I use the proxy, but not when I don't. Mine, alas, is missing whichever way I look.

It looks like US-based (and presumably other international) searches on "google.co.uk" are routed to different DC's where (presumably) a different incarnation of the errant filter/alorithm is running. Unfortunately the Firefox "Show IP" extension only gives me the IP of the proxy, so I can't tell which DC(s) it is.

I can't think of any straightforward way to make use of this discovery, but if anyone has an idea...

Pirates




msg:3191944
 1:34 pm on Dec 18, 2006 (gmt 0)

Today not seeing a problem on one of the UK .com's I was working on. Will it last, we'll have to wait and see. Anyway its Christmas so I am going off to stuff my face with food, get drunk and insult my relatives. Have a good one to and wishing eveyone a happy new year.

M_Bison




msg:3203572
 5:45 am on Dec 30, 2006 (gmt 0)

I'm back out again now!

What happened was I changed the title tag on my home page and now it's gone from the AU index.

I found the problem though, there is a page www.example.com/subpage/ that has a very similar meta description as the home page. When doing a site command on google.com.au with the "Pages From Australia" /subpage/ shows up, but without "Pages From Australia" /subpage/ does not show up.

Again, this is more evidence supporting my theory that this problem is caused by duplicate content, or at least caused by similar/same <head> content (titles, meta tags etc).

Meranda




msg:3203750
 3:55 pm on Dec 30, 2006 (gmt 0)

Hi
I have a site where the .com (hosted in UK) was ranking very well in uk and www pages.

I have been hit and where I rank no 2-4 in www pages, I am now number 60ish in uk pages - until yesterday I always maintained rankings in top 6 of .co.uk pages and www for many searches. The site is uk based, focued and has more links in from .co.uk sites than .com

I do also own the .co.uk of the same domain, and have a different site - much smaller - but older than the .com - it has the same theme, but no duplicate content etc... and has always enjoyed similar rankings bobbing about around the .com in serps. It is hosted with a different compnay, but the who is details are the same.

Having read all the interesting post above I am wondering if there could be any releveance in the following:
My .co.uk links the .com - from the home page only, and does feed a substancial amount of traffic across.
the .co.uk is ranking in both www and .co.uk pages - could the .com have been knocked out of the top .co.uk because it has been recognised that the .co.uk is linking to it and is a similar theme - same who is data and therfore deming the sites as one?

I am sure that there isn't a community issue - just one link - but could traffic transfer together with whois have made .com fall so badly in .co.uk results?

mirrornl




msg:3203834
 6:12 pm on Dec 30, 2006 (gmt 0)

index of my .com hosted in the netherlands is the only missing page in local search, showing up in www

Pirates




msg:3204141
 3:41 am on Dec 31, 2006 (gmt 0)

Again, this is more evidence supporting my theory that this problem is caused by duplicate content, or at least caused by similar/same <head> content (titles, meta tags etc).

I am working on same theory as well. Although in this case a proxy hijack that pretty much does the same thing. ie. produces duplicate content. By duplicating the content of a non country specific domain in such countries as lets say Thailand (why did I think of that country, maybe because I was there recently and saw the original Star Wars Movie) I believe it then causes a problem on country specific results. My problem in curing this is not about blocking or identifiying the hijack but in google's speed at recrawling the copied content thats now shutout.

The idea of changing meta tag and title and description to speed up this process may provide the answer, but its important the proxy hijack is broken first.

bigcroc




msg:3205241
 10:33 pm on Jan 1, 2007 (gmt 0)

Wonder if they'll solve this in 07?

I've been experiencing the same problem for months now. However, when i perform the 'pages from the uk' search -- the first 4 sites are all uk based .com sits - which leads me believe that since these 4 sites maintain 1st page results across G.com, G.co.uk and G.co.uk (pages from the uk) -- there must be something specifically about my site that google doesn't like...hmmm....<scratching head>...wonder what it is.

M_Bison




msg:3205438
 4:46 am on Jan 2, 2007 (gmt 0)

have you recently changed your home page?

It only seems to occur when I change my home page.

Other than that, check for duplicate content such as:

/ - index.html
https - http
query strings
meta tags, titles etc
any other duplicate content you may have

Pirates




msg:3205442
 5:20 am on Jan 2, 2007 (gmt 0)

I dont think this one is for us to solve. If google wanna continue to serve #*$! pages in the UK, so be it. Like I said before these clowns can't even recognise ITV.COM as a uk domain and the person sitting in the plex in charge of uk results probably doesn't understand how bad that is (you know American Idol, we invented it, on ITV.com). The need for european own search engine becomes more vital.

[edited by: tedster at 2:39 pm (utc) on Jan. 3, 2007]

Pirates




msg:3205447
 5:33 am on Jan 2, 2007 (gmt 0)

You know what. I think we should let google become what it aspires to be , a really good USA search engine. The rest of the world can go off to regional SE's combined on a new platform. It would be just like football. You have American Football (don't they have a world series that only includes american teams). And then you have real football that the rest of the world take part in.

Search on google.com for "Football".
Top result="NFL.com - Official Site of the National Football League"

Even though the largest tv audience in the world is for the definition of football as the rest of the world understands it is the world cup final. And the largest search term on "football" in the world.

Google #*$! off back to states I need an SE that doesn't think the world resolves around the America.

[edited by: Pirates at 6:00 am (utc) on Jan. 2, 2007]

bucklersbury




msg:3206753
 1:06 pm on Jan 3, 2007 (gmt 0)

I have just been hit by the problem. However I have made a number of changes in December so hard to isolate the problem.

We have a popular .com site but is hosted in UK and is for UK market.

Specifically I have moved to a new server on a different IP in December (IP and server is still UK based). Also the noodp meta was put on the home page - based on the comments could this really be a culprit? Also in Nov, a geoIP script was put in place to serve a different banner to US IP address - in my mind this seems like the most likely issue.

mattg3




msg:3206764
 1:20 pm on Jan 3, 2007 (gmt 0)

the world resolves around the America

Well especially on the Net it does. Most Business angels in the world weren't up to scratch on IT, hence the big ideas were funded in America. I worked with people at FU Berlin having an algorithm like Google in 1997 and they were running their feet flat, unsuccessfully, for funding. Although I doubt the world would have backed a SE not in english.

So we need to firmly look at the UK, Australia and the other native English speakers to hopefully find some less risk averse investors.

Just do what you did with American Idol and the Office in IT. Come on Britain..!

mirrornl




msg:3207195
 8:12 pm on Jan 3, 2007 (gmt 0)

index of my .com hosted in the netherlands is the only missing page in local search, showing up in www

today found also index only missing for a .info
same criteria

anything new out there Pirates?

M_Bison




msg:3212954
 6:37 am on Jan 9, 2007 (gmt 0)

Finally Google acknowledgement:

[groups.google.com ]

sunny_kat




msg:3213010
 8:04 am on Jan 9, 2007 (gmt 0)

Even i see my home page missing when i try and search site:

any particular reasons for the same or its a nood error by google

mcdermc




msg:3213181
 11:45 am on Jan 9, 2007 (gmt 0)

"mcdermc 3:35 pm on Nov 17, 2006
My view - don't worry: it's almost certainly nothing you've done. It's them!"

I told you so - (Isn't it nice to be right - at least once)!

sunny_kat




msg:3213204
 12:10 pm on Jan 9, 2007 (gmt 0)

But why only the homepage going out of the index

Is this some kind of a penalty of a data refresh

mcdermc




msg:3213249
 12:45 pm on Jan 9, 2007 (gmt 0)

sunny_kat, I think you'd have to pose your question to that nice Google-spokesperson Adam Lasnik who is quoted in the string that M_Bison posted:
From: Adam Lasnik
Date: Mon, Jan 8 2007 10:49 pm
We're aware of some issues with these searches, and expect to have a fix in soon. Might take a bit for it to propagate across all data centers.

NB: But of course Adam wouldn't tell - and nobody else knows. My view? - forget about the conspiracy theories postulated by some in this thread: it's usually not malicious, just a mistake, by Google (they do make 'em, you know).

fishfinger




msg:3213328
 2:18 pm on Jan 9, 2007 (gmt 0)

At last, Google have noticed! It only took 5 months, 2 threads in Google WMasters forum, 3 three posts on Matt Cutts Blog plus pestering our AdWords rep...

mcdermc




msg:3213369
 3:17 pm on Jan 9, 2007 (gmt 0)

Congrats to you Fishfinger - I know you've been the most consistent snapper-at-their-heels in chasing this particular issue down. The slumbering giant awakens, eh? Nice job!

fishfinger




msg:3213453
 4:17 pm on Jan 9, 2007 (gmt 0)

Actually I think that all my attempts were ignored so I dount I can take much credit for the breakthrough!

But someone managed to get Adam Lasnik's eye and that's great news AFAIC. I'd LOVE to know what the problem actually is... assuming that I could understand it :)

fishfinger




msg:3213454
 4:17 pm on Jan 9, 2007 (gmt 0)

Actually I think that all my attempts were ignored so I dount I can take much credit for the breakthrough!

But someone managed to get Adam Lasnik's eye and that's great news AFAIC. I'd LOVE to know what the problem actually is... assuming that I could understand it :)

sunny_kat




msg:3213509
 4:52 pm on Jan 9, 2007 (gmt 0)

Dear mcdermc

Thanks for the updates

even i hope that the error gets fixed and we see some positive shows

bigcroc




msg:3214522
 11:39 am on Jan 10, 2007 (gmt 0)

Got all my .co.uk (pages from the uk) results back. Wonder if during the latest update someone in the plex has decided to sort out this problem.

bucklersbury




msg:3214551
 12:11 pm on Jan 10, 2007 (gmt 0)

my .com is now back on a site:doamin.com on uk only results

Lets hope this is now fixed.

Wilburforce




msg:3214576
 12:38 pm on Jan 10, 2007 (gmt 0)

I'm not back in yet. However, Google haven't actually gone much beyond acknowledging the problem:

We're aware of some issues with these searches,

doesn't really tell us anything we hadn't already guessed, and saying they

expect to have a fix in soon.

may well mean they haven't found a definitive solution yet (although they probably now believe they are - at last! - on the right track). If and when they do find and implement a solution, it

Might take a bit for it to propagate across all data centers

which is another way of saying we shouldn't immediately expect to see it working.

Don't hold your breath, in other words.

< continued here:http://www.webmasterworld.com/google/3216350.htm >

[edited by: tedster at 6:16 pm (utc) on Jan. 11, 2007]

This 211 message thread spans 8 pages: < < 211 ( 1 2 3 4 5 6 [7] 8 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved