Welcome to WebmasterWorld Guest from 54.196.244.206

Forum Moderators: open

Message Too Old, No Replies

Googles Handles Server Failure

     
1:30 pm on Mar 3, 2005 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38047
votes: 11


[nwc.linuxpipeline.com...]

Ensuring reliability was another concern. With so many commodity hardware servers, "expect to lose one a day," he said. Google decided to "try to deal with that in an automated way. Otherwise, you will have lots of people running around trying to restart servers."

cnet [news.com.com]

According to Hoelzle, Google has inexpensively built out its computing infrastructure by using thousands of "commodity" servers, instead of fewer high-end, and high-priced, machines. The trick is to make these racks of hardware work together and to ensure that the failure of one machine doesn't derail an operation.
5:23 pm on Mar 3, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 18, 2003
posts:921
votes: 0


Secret to success: keeping your users interests first, no matter the circumstances.

Hoelzle then flashed a picture on the screen of six fire trucks at a Google data center. "I can't tell you what happened, but it's not about one machine going down," he said. He didn't disclose when the incident occurred. "No users were harmed in this picture," he added.
12:51 am on Mar 4, 2005 (gmt 0)

Preferred Member

10+ Year Member

joined:Apr 13, 2004
posts:428
votes: 0


Is it kind of weird they won't tell us what happened? Or is that just me?
3:03 am on Mar 4, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 20, 2002
posts:810
votes: 0


Is it kind of weird they won't tell us what happened? Or is that just me?

If you owned a large public company and one of your "super-smart phd's" forgot to extinguish a cigarette correctly, left a candle burning, or went crazy from coding too much and developed para maniac tendancies, would you want to tell people about it?

12:35 pm on Mar 4, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 10, 2001
posts:731
votes: 0


Or used a half-a-dozen extensions in chain, with everyting plugged into one circuit, one extension cord. Seen it. Have put fire out on it. Stinks. Literally.
6:12 pm on Mar 4, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 13, 2005
posts:1077
votes: 0


man, I wish there was another 10 pages explaining their technology. :( good read.
6:16 am on Mar 5, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Aug 19, 2003
posts:701
votes: 0


If one of us had been there, we could've put out the fire with our free Google beach towel...

:-)

7:11 am on Mar 5, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 4, 2002
posts:1314
votes: 0


another 10 pages explaining their technology.

One major chunk -- the filing system -- explained here:

[labs.google.com...]

Also possibly explains (see other current thread) why they need good operating system developers.

9:56 am on Mar 8, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 13, 2003
posts:95
votes: 0


there's good lessons here for small-scale webmasters too...

I spent a long time trying to find a hosting provider which actually delivered on the 99.99% uptime claims (I never found one).

I finally figured out I was better off going with two cheap providers that were reasonably good - say 99.5%

with some monitoring software that automates fail-over via dynamic DNS - a server can crash when I'm out hiking and things keep running...

side note: google actually seems to be down at the moment...

Xoc

2:41 pm on Mar 8, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 18, 2001
posts:1437
votes: 0


I wonder what kind of hardware they are using for their servers. Who makes the components? Can I buy the same hardware?
8:05 pm on Mar 8, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 13, 2005
posts:1077
votes: 0


Not knowing what your specific requirements are, Xoc, have you seen these:

[google.com...]

Chip-

Xoc

9:59 pm on Mar 8, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 18, 2001
posts:1437
votes: 0


Yeah, but that's not what I'm interested in. What I want is a cheap reliable web server. If Google is buying these things in the (tens of?) thousands, the price is probably pretty good, the components field tested and reliable, etc. When something dies, can it be replaced easily. Etc. If it's good enough for Google, it's probably good enough for me.