Datacenter Watch: 2006-06-09

[g1smd]

< continued from [webmasterworld.com...] >

Now this is interesting.

A site with 40 000 "real" pages and some 80 000 duplicate content pages excluded using robots.txt (it's a forum - see my prior posts about vbulletin) and still some 80 000 duplicate pages that are not yet so excluded.

Additionally some 500 000 non-thread pages also excluded in robots.txt and most of those already delisted. The whole site is listed as www; nothing is listed as non-www at all.

Looking purely at indexed threads:

site:domain.com shows 90 000 www pages all as normal results; including some duplicate content that will eventually be excluded.

site:domain.com -inurl:www shows 24 000 www pages all of which are marked as Supplemental Results and all of which also have an old cache date. This search should show zero results. It certainly should not be showing www pages at all, the search was for "-inurl:www". What is going on?

[edited by: tedster at 8:44 pm (utc) on June 13, 2006]
[edit reason] split into new thread [/edit]

[soapystar]

to whom it may concern:

You just go ahead and make some $$$$ for the kids university costs. Just don't tell anybody that I have suggested that :-)

Reseller said that!

[Hissingsid]

Hi,

What I have been calling the old results have now changed and in my opinion for the worse. They were bad before but now paid for links with "search term" in visible link text is being rewarded even more. A quick search shows two sets with some slight variability in my niche in the "New Crap" DCs.

What I am calling "New Good Stuff" here is what some of us have been holding our collective breath's for.

New Crap
64.233.179.107
66.102.9.107
72.14.207.107
216.239.37.107
216.239.39.107
216.239.57.107
216.239.39.104
216.239.37.104
216.239.53.104
66.102.11.104
66.102.9.104
216.239.57.104
64.233.161.99
72.14.203.99
72.14.203.104
72.14.203.107
72.14.207.99
72.14.207.104
72.14.207.107
216.239.37.99
216.239.39.99
216.239.57.99
66.102.11.99
66.102.9.99
64.233.179.99
64.233.179.104
64.233.185.99
64.233.185.104
64.233.189.104

New Good Stuff
64.233.183.107
216.239.53.107
216.239.59.107
216.239.57.147
216.239.59.147
66.102.7.147
64.233.167.147
216.239.63.104
216.239.59.104
66.102.7.104
64.233.167.99
64.233.161.104
64.233.167.104
216.239.53.99
216.239.59.99
66.102.7.99
64.233.183.104
64.233.183.99
64.233.187.99
64.233.187.104

I still live in hope that the "New Good Suff" will win out.

Sid

[edited by: tedster at 7:29 am (utc) on June 14, 2006]

[petehols]

Hi hissingsid

I totally agree with this conclusion the new good stuff is the way forward and hopefully The Big G will realise this. The new good stuff shows a far better return for searches and far more targeted to what people are looking for. In the words of the Big G "build it for the customers!" I think G should take a leaf out of their book and proprogate the new good stuff as that would definately be built for the customers.

Also the questions asked about whether they would prefer showing good results in the natural listings I think should be answered with YES! because if they are showing good results in the natural listings it would benefit the customer and they would be more likely to stay on google for longer again increasing revenue and page impressions of the ads.

Just my 2 cents worth anyway.

pete

[toothake]

aol .com and aol.uk back to the good old results again.

[Instigator]

I'm seeing the old results back on google.co.uk at 66.249.93.104 but the new results on comcast at the same DC 66.249.93.204

[lgn1]

Back in the old days (Before BigDaddy), how long did it take for Updates to spread across all the datacenters?

I was never involved in Datacenter watching before this year.

[Keypoint]

Is sharelive - this a new google url (http://www.sharelive.com/)?

[Nicke]

I also prefer New Good Stuff results, at least it is better for me but some competitors may think different.

To be honest, I think something is wrong with the new crap results.

[junai3]

I like the new good stuff too. A lot of spam sites buying links are showing up in the new crap. Come on new good stuff...come on baby! My fingers are crossed.

[steveb]

Those "new" results haven't existed for a few days now. After introducing them Google saw fit to add seemingly millions of spam pages, particularly simpleton redircts, to the results. While several months ago their update process involved adding spammy results then culling out the spam, they have reversed that here to the problems they had before that, adding new results that get degraded by their basically corrupt index. Supplementals from 2004 on hyphenated domains are back. The positive thing they tried to do seems to have utterly failed once again.

[oaktown]

sharelive.com

If that's the shape of things to come...I love it! (at least in my nano-micro-niche)

SteveB, FWIW, I think you're on target as usual. G seems to have a standard practice of testing by implementation, rather than test - THEN implement.

We stand in the wading-pool filled with gasoline and they throw matches. Sometimes we get burned, sometimes we don't. There's just no telling what those whacky fellows in the Gplex will do next.

[fred9989]

This all points to a process which is effectively out of control, IMO.
"Test by implementation" rather than "test then implement" - which does indeed seem to be what is happening - means that they are no longer confident of their ability to judge what is good and what is not (or, worse, they have decided to abandon quality standards); instead, they rely on the response of users to search results to determine what they implement.....something akin to letting the lunatics run the asylum.
Rod

[soapystar]

since bd its has been a spammers fantasy. The pro spammers who know what they are doing are having a field day. Grey hat is being culled on mass but the real big spamming is now out of control.

[steveb]

I don't know where that sharelive.com URL comes from, but it does seem to be the last place the old "new" results are mostly there (still there is way more garbage than the original batch tho).

[g1smd]

Hmm. Whacky.

site:domain.com -inurl:www returns several thousands of www pages marked as Supplemental with old cache dates (without the -inurl:www parameter you get 100 000 normal www pages listed).

site:domain.com -inurl:forum returns thousands of forum (folder name) www pages marked as Supplemental, all with old cache dates.

site:domain.com -inurl:www -inurl:forum is just as bad, if not worse.

site:domain.com inurl:www -inurl:forum shows loads of URL-only non-forum-URLs (but which are www URLs) and which have been excluded by robots.txt for the last 6 months.

[reseller]

lgn1

"Back in the old days (Before BigDaddy), how long did it take for Updates to spread across all the datacenters?"

If I recall correctly, it took around two weeks.

[petehols]

Hi all

I am now seeing the good new stuff on aol.co.uk and .com maybe there is still hope yet!

pete

[Hissingsid]

Hi,

I've just been back to see what happenned over night and 9 that I reported as new good stuff have now become new crap and 9 of the new crap have now become new good stuff.

The IPs therefore seem to me to be meaningless in terms of watching for migration. Are they switching machines with different algo/indexes on or are they simply messing around with their DNS servers and allocating different IPs to different machines.

Do they even realise that they have more than one data set?

Life's a lottery and I'm wondering if I've lost my ticket!

Best wishes

Sid

[edited by: tedster at 7:34 am (utc) on June 14, 2006]

[petehols]

Hi Hissingsid

I saw the exact same thing. It seems they are changing things over on a minute by minute basis. I don't think they know they have 2 sets of serp results out there. What happened to that google liason guy that was hired to liase with us webmasters and google has anyone seem him in here recently maybe he can shed some light on this topic. is it andrew or alan or something like that?

Pete

[petehols]

having done the search on mcdar 3 different times i was finding 24, 27 and 30 different DCs showing the new good stuff whichmeans there is so many changes happening on these DCs every minute.

Pete

[thecityofgold2005]

serps are all over the place. However, in amongst it all are sets of results that look much better..

What we need is Matt Cutts.. Nothing on his blog since 26th May and we are obviously in the middle of some sort of update..

[soapystar]

if by update you mean 9 months of turmoil and constant churn then yes we are in the middle of it...but then to say its the middle means you know where the end is..do you?

[toothake]

"Nothing on his blog since 26th May "
Just some humble thoughts.
Start counting from 26th of May when MC went on vacation plus the 6 weeks he will be away gives a kind of conclusion that after the second week of July we will see probably the beginning of a back link and PR update following by the brand new Google index?.IMHO of course.

[reseller]

soapystar

"if by update you mean 9 months of turmoil and constant churn then yes we are in the middle of it...but then to say its the middle means you know where the end is..do you?"

IMO, and I said it before, from now on Google's serps shall be in continuos dynamic movements. You may call it For-Ever-Flux. However, there will be of course some short periods with relative stable serps, IMO again :-)

[Enkephalin420]

I am now seeing "New Good Crap Stuff" spread out across all data centers!

Oh wait...

The new good stuff just went back to the "good old crap" of several weeks ago on the "New Good Crap" data centers.

Anyone else seeing this? ;)

[sandpetra]

IMHO we know it's just your opinion :)

[sandpetra]

Just had a terrible thought - what if this is the way forword and Google is always in flux from now on - thats us all scr*wed!

[toothake]

sandpetra
any HO?

[sandpetra]

Yup - I'm going slowly bonkers :)

[petehall]

IMO, and I said it before, from now on Google's serps shall be in continuos dynamic movements.

Websites will always shuffle regularly as certain factors change but an update is still definitely required...

As far as I am aware there has not been one since November.

There are so many webmasters now with <12 month old websites that are ranked everywhere bar Google - in my opinion that's not a coincidence and they are all awaiting an update.

We're not talking about a small drop in positions on Google - most sites aren't even recognised in the top 900 on competitive phrases which just can't be right at all.

So I'm afraid I don't buy into your continuous dynamic movements theory at all.

I think you're confusing 'updating' (as in adding / updating data) the index with 'updating' the calculation / ranking of the index.