homepage Welcome to WebmasterWorld Guest from 54.197.147.90
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Search Engines / Directories
Forum Library, Charter, Moderators: Webwork & skibum

Directories Forum

    
DMOZ offline October 20, 2006
Hardware Failure Takes DMOZ Down (Oct 24 back online with editor server issues)
RonS




msg:3129148
 8:56 pm on Oct 20, 2006 (gmt 0)

I can't get to the DMOZ at all.

Anyone else?

 

Iguana




msg:3129214
 9:56 pm on Oct 20, 2006 (gmt 0)

Same here - no sign of it

Monksp




msg:3129416
 2:09 am on Oct 21, 2006 (gmt 0)

Just checked myself, looks like there is something going on.

pele




msg:3129484
 4:10 am on Oct 21, 2006 (gmt 0)

The about page (about.html) comes up for me but not the main page.

windharp




msg:3129581
 6:38 am on Oct 21, 2006 (gmt 0)

The main ODP server has a hardware failure, and needs repair. According to staff, they had to contact the manufacturer for spare parts, so the repair will take some time.

That you can access some documents, but most of the system is not reachable, is a little bit more difficult to eplain. The public servers are a cluster of machines which take the data from the main server (which is down) and cache it for some days to reduce load. So if documents are still in their cache (like some of the static documents), you will be able to access them for some time. Because www.dmoz.org is a cluster, several attempts to access a file might lead to different result.

RonS




msg:3131067
 10:37 pm on Oct 22, 2006 (gmt 0)

Thanks Windharp.

How can they possibly rely on a single server as their main data store and not have a backup or a plan for a failover of any sort? How can they not have the "public server" cluster able to continue to serve up the directory during the time the "main server" is down?

How do you know this, are you privvy to inside info? Is the info on this downtime being published anywhere other than this thread? Is the DMOZ's architecture publicly available?

I'm really just curious, but an acquaintance of mine from another webmaster's forum (foolishly?) relies on the DMOZ for a substantial portion of his website and traffic.

Thanks.

Leosghost




msg:3131074
 10:56 pm on Oct 22, 2006 (gmt 0)

as of now it's working "jest fine" ..

reports of it's demise were somewhat premature ..( and despite the wishfull thinking of many )..it appears to be online ..even if that upsets some folks around here ;-)

nothing is perfect ..dmoz is no exception ..get over it ..that isn't what it's there for ..yay! for diversity!

it isnt the fault of dmoz if google uses it as some sort of bench mark ...and even less if one cant get in ones preferred category and have ones preferred place there within ..

anyone basing their traffic on their place in dmoz is being woefully naive ..sacrificing chickens at dawn might well be just as relevant ..and one would be equally as entitled to ( female dog ) at the chickens if it didnt result in a better result in serps ..

[edited by: Leosghost at 11:01 pm (utc) on Oct. 22, 2006]

hutcheson




msg:3131186
 1:45 am on Oct 23, 2006 (gmt 0)

>How do you know this, are you privvy to inside info? Is the info on this downtime being published anywhere other than this thread?

It's published first in internal editor forums.

>Is the DMOZ's architecture publicly available?

There have been some public discussions of its network. (It's really quite simple--fewer than a dozen servers, most of which the public doesn't see. Don't think of it as a portal: think of it as a content-development workshop -- to take another well-known online example, dmoz.org is not like Project Gutenberg, it's like Distributed Proofreaders.) As is appropriate for a development system, the focus is very much on data integrity rather than on data availability, with the expectation is that licensees will provide always-available "public access" from their own servers.)

>an acquaintance ... (foolishly?) relies on the DMOZ for a substantial portion of his website and traffic.

If his concern is on data availability, and a lot of traffic is involved, he should (definitely!) be hosting a clone of the ODP via RDF-publication rather than depending on parasitic syphons on the public servers.

mustang_lex




msg:3131191
 1:48 am on Oct 23, 2006 (gmt 0)

I just tried to submit a link tonight an no go :(

hutcheson




msg:3131325
 4:21 am on Oct 23, 2006 (gmt 0)

The "suggest a site" functionality resides on the edit server (after all, it's the edit server, not the public servers, which must keep track of unreviewed-suggested sites.)

The (internal-forum server and the search servers are also pretty much independent of the edit server.

RonS




msg:3131392
 6:47 am on Oct 23, 2006 (gmt 0)

I'm also an editor in the DMOZ, and I wasn't able to reach the DMOZ via the editor's URLs that I have. Perhaps there are others of whose existence I am unaware. Would you sticky me the URL? Thanks.

[edited by: Webwork at 12:47 pm (utc) on Oct. 23, 2006]
[edit reason] Please initiate a new thread to introduce entirely new issues [/edit]

tschild




msg:3131412
 7:27 am on Oct 23, 2006 (gmt 0)

The Resource Zone (linked from this forum's charter) is online (as it's independent of the ODP); also the server for the editor fora is not affected (cannot post the URL here but it should be in your browser history...)

windharp




msg:3131434
 7:56 am on Oct 23, 2006 (gmt 0)

Just FYI: In the meantime, the public pages have been restored from a backup, so that people can at least browse the categories. The editor server is still not repaired. So editing, suggesting sites, and other interactive features are still not working.

[edited by: Webwork at 3:15 pm (utc) on Oct. 24, 2006]
[edit reason] Emphasis Added [/edit]

Webwork




msg:3131615
 1:01 pm on Oct 23, 2006 (gmt 0)

It appears that the ODP is back online, subject to Windharp's comment, therefore this thread is being locked to avoid another round of threads veering off into subjects well beyond the original poster's intent.

If anyone wishes to raise new issues relating to the outtage - such as consequences of the outtage or the need for redundancy - please initiate a new thread and the same will be promptly activated if it is in compliance with the Charter.

[edited by: Webwork at 3:14 pm (utc) on Oct. 24, 2006]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Directories
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved