Forum Moderators: open

Message Too Old, No Replies

Distressing DMOZ Downtime

Is this a signal?

         

rogerd

3:53 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Is anyone else concerned that the recent spate of lengthy prime-time outages is sending a message about the importance (or lack thereof) of the directory to its owners?

It's hard to imagine any other site of similar significance that is so willing to both schedule outages during prime usage time and tolerate (apparently) unplanned ones. I realize we aren't talking about a site like eBay here, but just about every site of any significance attempts to avoid downtime for any reason. If an outage must be scheduled, typically it is done in the wee hours on a weekend to avoid interrupting most users. Normally, too, major changes may be tested using redundant systems so that if unexpected problems are encountered it's not difficult to roll back to the functional setup.

DMOZ may not be taking orders online, processing travel reservations, etc., but letting these kind of protracted outages happen risks alienating the volunteer editors that are so critical to its survival as a viable resource. Legitimate site owners will also be discouraged if they keep trying and can't get through. (The spammers will just try later...) Overall, the whole experience certainly suggests a feeling that DMOZ isn't important enough to maintain and upgrade properly.

fathom

3:58 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Updates and coding changes, I don't read anything more than that.

Napoleon

4:23 pm on Oct 16, 2002 (gmt 0)



I agree. I think it is a disgrace that the current owners are demonstrating such blatant disrespect. The ODP is an EXTREMELY important part of the net.

If they can't maintain it properly they should hand it over to someone who will (Google?). I get the feeling though that they would rather kill it than give it someone who knows how to use its prestige positively.

bird

4:27 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The ODP site itself is of no importance to the rest of the net.
I'd rather have them do the necessary maintenance than chasing some pointless uptime schedule. Dmoz.org is not designed for end users. The only thing that counts is that the editors will find their tools improved once it is back up.

Quinn

4:35 pm on Oct 16, 2002 (gmt 0)

10+ Year Member



"Dmoz.org is not designed for end users. The only thing that counts is that the editors will find their tools improved once it is back up"

Did I miss something?

Why manage all of that information for the sake of the editors? If that was the case then why would anyone who wasn't an editor care if the editors saw their site?

creative craig

4:48 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I do have to agree with Quinn, what would be the point in running the biggest human edited directory on the net, if no one cares about it except the editors?

Napoleon

4:54 pm on Oct 16, 2002 (gmt 0)



The fact is that the ODP is of great importance... and could have a fundamental role in the future of the net if managed properly. It is that management and vision that seems to be lacking at present and needs to be sorted.

jackofalltrades

4:56 pm on Oct 16, 2002 (gmt 0)



Just because the average surfer doesnt realise the important part the ODP plays in the organisation of the net doesnt mean it isnt important.

I think the main thing is that the editors care about what they are doing - that way the end product is of a high quality.

Lets face it - all us volunteer editors arent doing it for the glamour and recognition, are we?

JOAT

fathom

4:59 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Quinn and creative_craig I think you have missed bird's point.

The database backend management system currently in use was never designed as user friendly.

With the upgrade comes better, faster more efficient service from volunteers that like doing what they do.

I for one will be much happy to wait -- (since I do wait when DMOZ is running -- the old way).

bird

5:01 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Fathom got it right.
The dmoz.org site is made for the editors. The data is made for everybody else.

The recommended way to use that data is per the RDF dumps, which makes the end users completely independent from the dmoz.org uptime. Those sites that "leach" directly from the site are currently tolerated, but face the risk of going down with it during each maintenance term. If you want to search the ODP data in an efficient way, use the Google directory. It is both faster and offers much better search features.

rogerd

5:01 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



I think the point Bird was making wasn't that DMOZ is irrelevant, but that the dmoz.org site itself is used by relatively few end users.

I agree with the comment about dmoz.org traffic up to a point, but I don't think that justifies the lengthy outages we are seeing. I've got sites that do far less traffic than dmoz (and are of infinitesmal importance by comparison), but I'd be horribly embarrassed if planned upgrades (or any kind of failure, for that matter) caused this sort of downtime. These outages suggest a lack of testing and/or a lack of a backup plan if problems occurred.

rogerd

5:02 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Whoops, I posted at the same time Bird was explaining his own comments! Sorry to put words in your mouth, Bird!

creative craig

5:05 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ahh I see what you mean now, and I agree :)

Quadrille

5:14 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



According to rumor - no more than that - the current outtages are part of a major sortout of software that's been tweaked, twisted and curved over the years - once completed, the site will be easier to use for editors, and easier to manage (security, editor monitoring etc) for The Mngmnt. My sources don't specify effects (if any) on the data, but if the internal search improvement continue, that'll be good for submitters as well as editors.

But I stress this is rumor ;)

fathom

5:15 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



dmoz.org site itself is used by relatively few end users

Well this is somewhat inaccurate. In September, my site recorded over a 1,000 visitors directly from DMOZ.org.

This maybe pale traffic compared to Yahoo, and market and research dependent, but alot better than Looksmart and Fast (at least for me).

rogerd

5:22 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



That sounds pretty good, Fathom. Dmoz.org isn't on the radar screen in most of my referral logs, even for sites that show up well in dmoz searches. I didn't mean to imply that dmoz traffic was low in absolute terms, but rather low compared to that of some of its larger users. I'm sure their traffic is high enough for most of us here to envy!

rogerd

5:31 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



One more comment and I'll shut up... Although I disagree with the concept of permitting an extended prime-time outage at all, if such an outage occurs I think it would at least add a note of professionalism to direct dmoz editors and visitors to a page that notes that a major upgrade is being performed and the expected time of service resumption. I've been getting a "server not found" error for ages.

cminblues

5:34 pm on Oct 16, 2002 (gmt 0)

10+ Year Member




We're sure it's only a maintenance problem? ;)

hutcheson

10:57 pm on Oct 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>Although I disagree with the concept of permitting an extended prime-time outage at all...

While most heartily sympathizing with the frustration of all of you who can't find your favorite site: a couple of points: For non-editors, it is just adding a day to the immensurable amount of time it will take to get a site listed, that's all. You aren't going to lose any visitors.

And, as to the proposal: I hereby nominate this the "King Canute Memorial Thread."

skibum

1:07 am on Oct 17, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Sounds like temporary inconvenience permanent improvements.

Beachboy

2:25 am on Oct 17, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I suspect it's not really maintenance. Maybe Dmoz is on some el-cheapo $4.95/month virtual hosting plan. Maybe the server went offline when somebody tripped over the power cord. Do you suppose...? ;)

cminblues

2:32 am on Oct 17, 2002 (gmt 0)

10+ Year Member




A little additional spec:

When I was unable to reaching dmoz.org [now it works], in fact the server was not down, it was firewalled on the 80. [->strange thing instead, 25 was not filtered :)]

So, seems logical, if this happened from 1 October [I don't know, don't tested before today], to assume that Googlebot has spidered dmoz in the last days, also if we've seen it down so often.

Seems logical to assume also some other things IMHO, but who knows.. ;)

cminblues

rogerd

7:43 pm on Oct 17, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



>>"King Canute Memorial Thread."<<

OK, I'll bite... :)