Google Datacenters Watch 2006-03-05

Observations, Analysis and Remarks

[eyezshine]

< continued from [webmasterworld.com...] >

Looks like more Datacenters have been updated to Big Daddy. I am seeing lots of traffic from 72.14.203.99

My new sites are getting tons of traffic from google.com today.

[edited by: tedster at 6:54 am (utc) on Mar. 6, 2006]

[Dayo_UK]

>>>You can't rollout new infrastructure "behind the scenes".

Yet this seems to be - and from MC comments - sounds to be what they are trying to do.

>>>Eventually you just have to introduce it and accept the changes that occur.

Eventually they will - this could be a reason for extra mess that has occured.

Reseller

Strange - a PR update was doable (although badly) before/during Big Daddy roll out too :)

Personally would have hoped for a more encouraging statement on Canonicals in MC post as this is supposed to be one of the reasons for this update - hmmmmz - letting us down slowly again like he and GG did Re:Canoninial issues in Jagger? Then again cant read to much in to a brief reply like that.

Had a few more sticky conversations and have still not found a site that had this supplemental problem of just the homepage being listed that was not due to Canonical issues.

66.102.9.*
66.102.11.*

Now look just about fully Big Daddy.

[yves1]

It looks like 66.102.9.99 and 66.102.11.104 were converted to Big Daddy overnight. I'm now seeing 95% Big Daddy on the DCs.

[Dayo_UK]

Yes, just 216.239.59.* and 72.14.207.* to go.

[Optimus]

If Ask.com used this opportunity to tweak their already decent results a bit more and then embarked on an agressive PR campaign, they may just be the engine able to give google a bruising (yes, of course it would take some time).

Surely big brother deserves some punishment for making such a mess of things and stuffing around with our work, time and efforts over the past 6 months, failing to properly rectify the problems, provide clean results and refusing to talk to this and other forums except via riddles, innuendo and mattspeak? google still sucks and continues to exacerbate the problem as they roll out BD - a classic non-solution if ever there was one!

In most other market sectors, customer loyalty would long ago have evaporated. I'm fed up with following this erratic search engine's shenanigans. Pity my work dictates that I have to...

[colin_h]

Hi Reseller,

"I'm assuming that you're using the term "We love Ya" very loosely ;-)"

When I said this I was more referring to your very wide ranging love for Matt. I would personally feel more comfortable with you declaring your personal love for him and not presuming to use "We" in your sentence. I for one, was not canvassed on this point.

All the Best

Col :-)

p.s. Congrats on your daughters' 18th birthday

[Ellio]

Hi Folks
I just read an interesting comment posted by Matt today on his blog. In his reply to questions by fellow webmaster regarding BigDaddy, here is what Inigo wrote:

"Harith, I can’t promise what we’ll do in the future, but things like a PR update seem doable after Bigdaddy is done. And all of the things you mentioned are things that I would like us to tackle down the road."

[mattcutts.com...]

Maaaaaaaaaaatt.. we love ya :-)

Reseller, we all know you are Harith on Matt Cutts blog so why the espionage?

[Ellio]

Looks like 72.14.203.104 may have gone permanently Big Daddy.

[frakilk]

Just saw some much improved results flicker onto 72.14.203.104 then disappear. Could this be one to watch?

[Ellio]

Fralik,

You probably saw the remnants of the old index.

It was switching back and forth but it seems to be settling down as Big Daddy only now.

[frakilk]

Remnants of a pre-Dec index maybe. Now it can be content with BigDaddy irrelevance instead. The BigDaddy virus has infected another DC.

[vonna]

Google need to limit the number of pages a site can have in the index, the number of pages in the index has increased at a speed you would not believe, try ro make a search for "a" , how many results do you get? "8,840,000,000" , that is alot of pages, do you remember when they hit 6.000.000.000 pages indexed, that was not so long ago, and now NOBODY knows how many pages they got.

One of the big problems is blog's , there is a never ending stream of web pages information in the blog's that are growing at rates you would not believe ( i stopped my own crawler for this reason, it's impossible to keep up ).

What i believe google is trying to do at the moment , is putting a limit on the number of pages a single domain can have in the index, but because they want to list the "most popular" pages from all sites, they need to crawl every pages on your sites.

It is not a easy task to limit the pages ( decide what pages to include etc.. ) , and i think this is what they are trying to do.

Or perhaps i'm wrong :)

[yandos]

I cannot see any reason why they would want to limit the amount of pages indexed for each site. The amount of processing power to work out which pages are useful and which aren't would take twice as long, as the spider would have to index all the pages to decide which ones to 'keep', then perform calculations based on this and finally perform ranking calculations.

[JuniorOptimizer]

One thing about Google, they don't usually get bogged down by "limits". I'm pretty sure they're happy to store every page every made by every person forever.

[Jamie_uk]

In my opinion they want to index as many pages as possible, they couldn't possibly offer the most relevant results if they keep the number of pages in the index the same...

it's that old saying you're either climbing or your falling, while you are standing still the rest of the world is still going!

[gcc_llc]

Small obsveration. M-bot is back at my site afer a layoff since March 6-7th. Before that is went for a good 28 days hammering my site(50k-90k) pages. The last 3 days he's back nailing me again. Who knows, they might need to recrawl again to fix the supp issue. Can you tell I'm grasping at straws here? :)

[reseller]

colin_h

"Hi Reseller,

p.s. Congrats on your daughters' 18th birthday "

Thanks, Colin. Much appreciated.

In fact she asked us to take her out to the movie this evening to watch "CASANOVA", and that we shall do :-)

[Pico_Train]

uh-oh, Casanova, 18 year old daughter, sit tight, the ride is about to begin...

[Oliver Henniges]

Yes, just 216.239.59.* and 72.14.207.* to go.

what about 66.102.11.***? irrelevant?
Still quite an number of DCs unavailable.
What if the final surprise is prepared there?

>>>Oh..I thought you know! That was the number on the Social Security Card of Matt´s female cat "Spamie" which is around 2 years old. In a latest comment, Matt reported that she in fact is gaining weight because of the Bacon Polenta portions that he presents her with :-)

So, no telephone number of a young female from Islington? How sad.

[Lorel]

My site is doing great on Big Daddy--major keyowrds ranking higher--almost surpassing the Christmas traffic now and growing weekly.

Come on Big Daddy!

[reseller]

Google Datacenters List - 20th March 2006

Hi Folks

Here is the updated list of Google Datacenters (only those of IPs ending with .99 and .104)

[64.233.161.99...]
[64.233.161.104...]

[64.233.167.99...]
[64.233.167.104...]

[64.233.171.99...]
[64.233.171.104...]

[64.233.179.99...]
[64.233.179.104...]

[64.233.183.99...]
[64.233.183.104...]

[64.233.185.99...]
[64.233.185.104...]

[64.233.187.99...]
[64.233.187.104...]

[64.233.189.104...]

[66.102.7.99...]
[66.102.7.104...]

[66.102.9.99...]
[66.102.9.104...]

[66.102.11.99...]
[66.102.11.104...]

[66.249.85.99...]
[66.249.85.104...]

[66.249.87.99...]
[66.249.87.104...]

[66.249.93.99...]
[66.249.93.104...]

[72.14.203.99...]
[72.14.203.104...]

[72.14.207.99...]
[72.14.207.104...]

[216.239.37.99...]
[216.239.37.104...]

[216.239.39.99...]
[216.239.39.104...]

[216.239.51.99...]
[216.239.51.104...]

[216.239.53.99...]
[216.239.53.104...]

[216.239.57.99...]
[216.239.57.104...]

[216.239.59.99...]
[216.239.59.104...]

[216.239.63.99...]
[216.239.63.104...]

If you know of any other .99 and/or .104 datacenters, pls be kind to post them on this thread and I shall include them in the next updated list.

Thanks.

[sore66]

My main kw has a bug. When you go to page 2 of the results, it loads 1-20, page 3 of the results load 1-30...it's a software bug.

[twist]

Lorel -

My site is doing great on Big Daddy--major keyowrds ranking higher--almost surpassing the Christmas traffic now and growing weekly.

Glad to see i'm not the only one benefitting greatly from this update.

[mahoogle]

sore66 - you may have a virus.

[mfishy]

I haven't followed this much, but I am seeing the newest serps on 216.239.59.107 without doubt.

[jrs_66]

--- I haven't followed this much, but I am seeing the newest serps on 216.239.59.107 without doubt.

Dude... not even BD... DOA

[MLHmptn]

My main kw has a bug. When you go to page 2 of the results, it loads 1-20, page 3 of the results load 1-30...it's a software bug.

Your not alone, I am seeing page 1 results 1-10, page 2 results 1-20, page 3 results 21-40 and my preferences within Google have not changed. It is a bug in Google or something with their new infrastructure.

[mfishy]

<<Dude... not even BD... DOA >>

Ok, dude, ROFL...

Yo if you believe matt cutts...about what dc may or may not go live, youa re absolutely 100% out of your mind...look at where the newest sht is showing up....man, talk about the sheep mentality...you just will NEVER GET IT

Big daddy....it's nothing, new serps will be rolling out all over the place. Get a grip mate. Matt has been spewing this crud about "big daddy" for how long now?

[sore66]

Yep, the NEW infrastructure.....meet the new boss, same as the old boss.

The url that ranked #1 for 3+ weeks in my kw is nowhere to be found.

Leave it to G to change relevance on a dime.

But what the hell, thank you G for the $....see you again soon.

[otech]

mfishy,

matt cutts has been saying BD will spread to all DC's until its on all of them by around the end of this month - he has been saying this for around 2.5 months - and surprise surprise just as he said - its been propogating across and is now at around 75% of DC's.

the IP you mention is from one of the few NON-BD servers left (you can test for this by running sf giants as a search tearm and getting giants.mlb.com as the first result).

So, what you are seeing will be GONE in the next week or so and is therefore irrelevant.

hence the comment from jrs_66 'dude, its not even BD'

[colin_h]

Although this DC is not BD, I can understand mfishy's point. Matt and GoogleGUY do talk in weak, non specific terms, telling us one thing and then going silent about it when it all goes wrong. When they say "The techs are looking at this" ... we think "Google loves me and their gonna make everything allright". I think that everything they say should be treated with a healthy amount of suspicion.

Lets remember that mfishy is a senior member and that should count for something.

All the Best

Col :-)

< continued here: [webmasterworld.com...] >

[edited by: tedster at 7:41 am (utc) on Mar. 21, 2006]