Welcome to WebmasterWorld Guest from 54.166.102.61

Forum Moderators: Webwork & skibum

DMOZ offline October 20, 2006

Hardware Failure Takes DMOZ Down (Oct 24 back online with editor server issues)

   
8:56 pm on Oct 20, 2006 (gmt 0)

10+ Year Member



I can't get to the DMOZ at all.

Anyone else?

9:56 pm on Oct 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Same here - no sign of it
2:09 am on Oct 21, 2006 (gmt 0)

10+ Year Member



Just checked myself, looks like there is something going on.
4:10 am on Oct 21, 2006 (gmt 0)

10+ Year Member



The about page (about.html) comes up for me but not the main page.
6:38 am on Oct 21, 2006 (gmt 0)

10+ Year Member



The main ODP server has a hardware failure, and needs repair. According to staff, they had to contact the manufacturer for spare parts, so the repair will take some time.

That you can access some documents, but most of the system is not reachable, is a little bit more difficult to eplain. The public servers are a cluster of machines which take the data from the main server (which is down) and cache it for some days to reduce load. So if documents are still in their cache (like some of the static documents), you will be able to access them for some time. Because www.dmoz.org is a cluster, several attempts to access a file might lead to different result.

10:37 pm on Oct 22, 2006 (gmt 0)

10+ Year Member



Thanks Windharp.

How can they possibly rely on a single server as their main data store and not have a backup or a plan for a failover of any sort? How can they not have the "public server" cluster able to continue to serve up the directory during the time the "main server" is down?

How do you know this, are you privvy to inside info? Is the info on this downtime being published anywhere other than this thread? Is the DMOZ's architecture publicly available?

I'm really just curious, but an acquaintance of mine from another webmaster's forum (foolishly?) relies on the DMOZ for a substantial portion of his website and traffic.

Thanks.

10:56 pm on Oct 22, 2006 (gmt 0)

WebmasterWorld Senior Member leosghost is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



as of now it's working "jest fine" ..

reports of it's demise were somewhat premature ..( and despite the wishfull thinking of many )..it appears to be online ..even if that upsets some folks around here ;-)

nothing is perfect ..dmoz is no exception ..get over it ..that isn't what it's there for ..yay! for diversity!

it isnt the fault of dmoz if google uses it as some sort of bench mark ...and even less if one cant get in ones preferred category and have ones preferred place there within ..

anyone basing their traffic on their place in dmoz is being woefully naive ..sacrificing chickens at dawn might well be just as relevant ..and one would be equally as entitled to ( female dog ) at the chickens if it didnt result in a better result in serps ..

[edited by: Leosghost at 11:01 pm (utc) on Oct. 22, 2006]

1:45 am on Oct 23, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>How do you know this, are you privvy to inside info? Is the info on this downtime being published anywhere other than this thread?

It's published first in internal editor forums.

>Is the DMOZ's architecture publicly available?

There have been some public discussions of its network. (It's really quite simple--fewer than a dozen servers, most of which the public doesn't see. Don't think of it as a portal: think of it as a content-development workshop -- to take another well-known online example, dmoz.org is not like Project Gutenberg, it's like Distributed Proofreaders.) As is appropriate for a development system, the focus is very much on data integrity rather than on data availability, with the expectation is that licensees will provide always-available "public access" from their own servers.)

>an acquaintance ... (foolishly?) relies on the DMOZ for a substantial portion of his website and traffic.

If his concern is on data availability, and a lot of traffic is involved, he should (definitely!) be hosting a clone of the ODP via RDF-publication rather than depending on parasitic syphons on the public servers.

1:48 am on Oct 23, 2006 (gmt 0)

5+ Year Member



I just tried to submit a link tonight an no go :(
4:21 am on Oct 23, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The "suggest a site" functionality resides on the edit server (after all, it's the edit server, not the public servers, which must keep track of unreviewed-suggested sites.)

The (internal-forum server and the search servers are also pretty much independent of the edit server.

6:47 am on Oct 23, 2006 (gmt 0)

10+ Year Member



I'm also an editor in the DMOZ, and I wasn't able to reach the DMOZ via the editor's URLs that I have. Perhaps there are others of whose existence I am unaware. Would you sticky me the URL? Thanks.

[edited by: Webwork at 12:47 pm (utc) on Oct. 23, 2006]
[edit reason] Please initiate a new thread to introduce entirely new issues [/edit]

7:27 am on Oct 23, 2006 (gmt 0)

10+ Year Member



The Resource Zone (linked from this forum's charter) is online (as it's independent of the ODP); also the server for the editor fora is not affected (cannot post the URL here but it should be in your browser history...)
7:56 am on Oct 23, 2006 (gmt 0)

10+ Year Member



Just FYI: In the meantime, the public pages have been restored from a backup, so that people can at least browse the categories. The editor server is still not repaired. So editing, suggesting sites, and other interactive features are still not working.

[edited by: Webwork at 3:15 pm (utc) on Oct. 24, 2006]
[edit reason] Emphasis Added [/edit]

1:01 pm on Oct 23, 2006 (gmt 0)

WebmasterWorld Administrator webwork is a WebmasterWorld Top Contributor of All Time 10+ Year Member



It appears that the ODP is back online, subject to Windharp's comment, therefore this thread is being locked to avoid another round of threads veering off into subjects well beyond the original poster's intent.

If anyone wishes to raise new issues relating to the outtage - such as consequences of the outtage or the need for redundancy - please initiate a new thread and the same will be promptly activated if it is in compliance with the Charter.

[edited by: Webwork at 3:14 pm (utc) on Oct. 24, 2006]

 

Featured Threads

Hot Threads This Week

Hot Threads This Month