Welcome to WebmasterWorld Guest from 54.162.240.235

Forum Moderators: rogerd

Message Too Old, No Replies

WordPress Outage 18 Feb: Unscheduled Core Router Change

     
12:34 pm on Feb 19, 2010 (gmt 0)

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month Best Post Of The Month



WordPress Outage 18 Feb: Unscheduled Core Router Change [en.blog.wordpress.com]
Today WordPress.com was down for approximately 110 minutes, our worst downtime in four years. The outage affected 10.2 million blogs, including our VIPs, and appears to have deprived those blogs of about 5.5 million pageviews.

What Happened: We are still gathering details, but it appears an unscheduled change to a core router by one of our datacenter providers messed up our network in a way we havenít experienced before, and broke the site. It also broke all the mechanisms for failover between our locations in San Antonio and Chicago. All of your data was safe and secure, we just couldnít serve it.
2:14 pm on Feb 19, 2010 (gmt 0)

5+ Year Member



They were quick did a great job by maintaining the transparency. I didn't even notice it. may be i was asleep :P
2:26 pm on Feb 19, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Stuff happens, nice recovery.
2:36 pm on Feb 19, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Let's see:

The outage affected 10.2 million blogs
deprived those blogs of about 5.5 million pageviews.

Then their average blog gets approximately 1.01127 pageviews per hour?!

Yes, I realize time of day might have had something to do with it, but still...it's kind of sad, really, to think about all the time being poured into blogs that nobody reads.
2:39 pm on Feb 19, 2010 (gmt 0)

10+ Year Member



MatthewHSE it's more likely that many of them get far less than that, probably a hit every few weeks when the author updates and that's it while few blogs get visits non-stop. furthermore, these are hosted blogs... most higher-traffic blogs will be professionally hosted on a dedicated server or cluster.
3:40 pm on Feb 19, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Yes, I realize time of day might have had something to do with it, but still...it's kind of sad, really, to think about all the time being poured into blogs that nobody reads.


It's more like a ton of blogs that haven't been updated in forever and no one bothers with.
8:53 pm on Feb 19, 2010 (gmt 0)

5+ Year Member



Never good when things like this happens but this week with the web hosting company I use they had a problem with the server and it was offline for a couple hours and then when I got back online it turned out my database for my wordpress blog was corrupted. So I had to repair that before I got the site back up and running. Overall, it was almost a half of a day off line. I didn't like it and it caused much stress especially since I am not a database guy but it is part of running a site.
1:22 am on Feb 20, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member




Then their average blog gets approximately 1.01127 pageviews per hour?!


No, just to clarify their blogs get an average of...

1.833 hours / 5,500,000 pageviews = just over 3 million pageviews per hour. 3 million pageviews an hour for 10,200,000 blogs = roughly 0.29 pageviews an hour on average (during that time period).
12:08 am on Feb 22, 2010 (gmt 0)

10+ Year Member



From what I can tell the the outage affected more than just the blogs hosted on the Wordpress servers. From what I can tell, blogs that use plugins which connect to the Wordpress API were affected too.

We host Wordpress sites on our own dedicated servers. A client called us during the outage to report that their site was down.

Upon closer inspection we found that the site was having troubles do to a stats plugin that uses the Wordpress api. The outage caused the plugin to not load correctly, which made it so the pages in the client's site could never fully load. Once the plugin was disabled everything in the site worked great again.

I imagine something similar happened to other sites using similar plugins.

I think it's testimate to the Wordpress.com's reach when over 10 million sites can be affected by an outage.

-JB
 

Featured Threads

Hot Threads This Week

Hot Threads This Month