Forum Moderators: open

Message Too Old, No Replies

DMOZ - Improving Feedback to Submitters

using the logs to provide feedback

         

NFFC

11:33 am on Nov 30, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A quick proposal;

Many of the common DMOZ questions relate to submission status, it can be quite frustrating at times for a submitter just not knowing if a listing has been denied, moved to another cat etc.

Why not use a referal string as a quick and cost free method of keeping a submitter updated. We are all used to seeing the editunrev in our logs, if that could be fleshed out just a little to include more information. So, if the site was moved to another cat then just send a refereal dmoz.org/blahblah/movedcat, listing denined dmoz.org/blahblah/notlisted etc etc

ettore

2:07 pm on Nov 30, 2002 (gmt 0)

10+ Year Member



First of all, a good 50% of the times I review a site I cut&paste the URL in a new browser window, and often in a couple of other browsers', too. This is to avoid dmoz-specific referral cloacking (in some areas it's quite common, you would be surprised about how many sites do this), and/or look whether the site has display problems in different browsers. I know that many editors do this, thus no dmoz referral string whatsoever is sent in these cases.

Also, there are a lot of internal actions an editor can perform when reviewing a site, not only accept/move/reject, and most of these should remain editor-only information.

Moreover, the editunrev referral is sent when an editor clicks on the link from the dmoz category unrevieweds editing interface to look at the site, before any action is taken. Any following action doesn't produce a referral on the site (in fact, the site can be moved/reviewed and listed/rejected/etc. after closing the window previously opened to look at the site). I'm not techie, but I don't think this suggestion could therefore be implemented.

martinibuster

4:48 pm on Nov 30, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I'm not a techie, either, but I think pretty much anything can be accomplished. Feedback is very important.

Perhaps it's fear on the part of dmoz that's keeping dmoz from providing feedback. It's definitely easier to do nothing than it is to be humane.

A submitter should know whether they submitted to the wrong cat and that you:
Deleted it because you're sick and tired of random submissions or
Moved it to a proper cat.

It's amazing how many people want their deep links.

Then, I've seen many url's get bounced from one cat to another, then to another one, then back to the original place it started at: Like a hot potato nobody wanted to handle.

In a case like that, a little communication and feedback to the submitters might also help speed the submission along. It can be a win-win situation.

It's a good thought but I think it's easier for things to stay the same.

Just my friendly observation. :)

victor

4:59 pm on Nov 30, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm a DMOZ editor, and I don't see any major reason why I can't have an "update and inform" button on the edit console along with the "update" button.

That'd send an automated email to (say) postmaster@submitters.domain telling them what I'd done. So I get a choice to inform them, or not.

For non-DMOZ editors: the update button does one of three things: publishes; deletes; or moves to another category. It may do the first and last similtaneously

Dante_Maure

5:19 pm on Nov 30, 2002 (gmt 0)

10+ Year Member



I'm a DMOZ editor, and I don't see any major reason why I can't have an "update and inform" button on the edit console along with the "update" button.

Can I get an AMEN! :)

ettore

5:41 pm on Nov 30, 2002 (gmt 0)

10+ Year Member



>> I think pretty much anything can be accomplished

Sure, but whereas I'm no techie I honestly don't see how a referral could be sent when the action of moving/listing/etc. is done after having looked at the site (which is the call which can send a dmoz referral string).
Editors who don't click on the link and visit the site from the dmoz interface won't in any case send any referral whatsoever.

>> I don't see any major reason why I can't have an "update and inform" button on the edit console.

I do see at least a very good reason: additional server load. If you think about the number of sites reviewed and listed every day (just look at the dmoz growth) and add to this update (url, title, description) actions, keep in unreview actions, move to another category actions, you total thousands of possible emails to be sent every day. The ability to send an "update and inform" email is therefore not a feature which is likely to be implemented.

john316

5:47 pm on Nov 30, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



server load<<

Think about all the "in the dark" submitters hitting the site everyday (hour)..too see if they have been listed.

martinibuster

5:57 pm on Nov 30, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Maybe others on this board know server loads better than us, but allow me to relate my hands on experience:

I did some html emails for a client, sent out 20,000 emails in an hour. There were no problems.

If I can blast out 20k HTML emails in an hour from one small little office, in my mind, I don't see how 20,000 emails spread out over an entire day can be a problem to dmoz.

20,000 emails seems like a large amount but it really isn't. Even 50,000 isn't so much.

Again, perhaps others more familiar with mail servers can drop their two cents here, and I may stand to be corrected, but based upon my real-world experience, I don't think there's any reason to be afraid of editors sending short, preformatted text emails (that weigh what, 10k?), throughout the day.

victor

6:10 pm on Nov 30, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



In my mind server load would be a minor reason why not.

** How many sites get published on DMOZ a day? Let's say 4,000 (I got no idea, so don't quote me). So it'd be maybe a couple of times that for all status changes (where a site is deleted or moved to another cat). 10,000 emails, which could be batched and sent at a quiet time? Not a great load.

I can see several other minor problems (minor to me):

-- Can't send to the submitter's supplied email address: they may not have given one; it could be a wrong email address -- maybe a competitor is submitting their details maliciously and inaccurately. Which is why I suggested to the "postmaster@" But

-- That doesn't work for shared domains like geocities and members.aol. Or at least not without a lot of fiddly URL parsing and exception handling.

-- Some people may not want a progress report -- strange but true. The submit form would need a checkbox "do you want progress messages". And what is the default for all the sites submitted before the change? That's probably have to be "no message" otherwise some people will report the progress message as a spam.

-- If DMOZ sends an email -- even a automated one -- some people will reply to that. Sudden Dialog! Not DMOZ's core competency!

None of these are insurrmountable.

kctipton

6:37 pm on Nov 30, 2002 (gmt 0)

10+ Year Member



Feel free to send feedback to staff and invite them to threads like this. There isn't a single thing _any_ ODP editor can do to implement or block such features.

NFFC

12:01 am on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Email would be a bad thing, it could/will encourage replies that will suck up bandwidth.

Last week I had an editunrev followed by [I think not got acess to the logs from here] a newlisting string? The job is almost done, I submitted, they looked and added. Just expand that to notlisted and/or movedcat and there is a system there, quick feedback, transparent to the editor almost cost free.

bird

1:12 am on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm usually skeptical about ideas that involve automatic notification of submitters from the ODP, since most are simply not practicable given the scale of the thing and the diverse editor community. This idea with the referrer is the first one that I'd give a minimal chance. The dmoz server could simply make a HEAD request to the respective page on certain actions, with a "fake" referrer string indicating what happened to the entry or submission. What you want to see in your logs is something like this:

dirt.netscape.com - - [27/Nov/2002:01:36:21 -0500] "HEAD / HTTP/1.0" 200 0 "http://dmoz.org/Business/Widgets/Wholesale/" "ODP-Notification: moved for review to /Business/Widgets/Green/Fuzzy/"

Now there would be some issues to solve with that. First, there is a certain minority of submitters, that we would prefer to keep in the dark as much as possible. Providing additional information to spammers about how to best abuse the system is not a good idea, after all. The procedure also shouldn't cause any noticeable slowdown for the editors when a site is unresponsive. This means that it probably would have to be handled asynchronously. The editing activity would put that request into a queue, and the server would execute it when it gets around to it.

The third and most severe obstacle is in the fact that only staff can decide and implement things like that. And the one friendly technical staff member we have faces a ton of more urgent problems, with no real prospect of that changing any time soon. As has been said elsewhere, getting the RDF dump out of the door has top priority. After that, tools that make the work of the editors easier come next. And anything for the benefit of the submitters is generally very low on the list. That's a disappointment to many, but not likely to change.

In short: Nice idea, but unfortunately only with a marginal chance of implementation in the short term.

Dynamoo

4:16 pm on Dec 3, 2002 (gmt 0)

10+ Year Member



Darn it, just send out an email (as for the cool sites) with the following information:

Status: Published/Deleted
Location: i.e. where it actually finally ended up
Title and Description.

If deleted then ANONYMISED editor comments should be listed. And the email should come out from an anonymous no-response address @dmoz.org.

I think if you want to make ONE improvement that would make submitters happier it would be improved feedback on site status. :)

bird

5:42 pm on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Darn it, just send out an email

The ODP can't send out 10k+ e-mails per day to unverified addresses. All hell would break loose if they did that.

rafalk

5:48 pm on Dec 3, 2002 (gmt 0)

10+ Year Member



Actually it would be closer to 20,000 emails.

Dynamoo

7:40 pm on Dec 3, 2002 (gmt 0)

10+ Year Member



The ODP can't send out 10k+ e-mails per day to unverified addresses. All hell would break loose if they did that.

Sure it can. And why not try to sell some herbal viagra at the same time? ;)

Alright, point taken.

If I remember Zeal verifies the submitter address, but then the whole Zeal submission process is very different.

OK, how about a transaction code that they can type into a query tool to see the tracking status (like UPS say). At the same time you could tighten up automated submissions by introducing an AltaVista-style humanity check. More coding, I know.

It's the old time + money = bugger all equation isn't it?

Frankly if the search function was working properly submitters might have a better time.. at the moment it's hard to find out if a site is in the directory for anybody :( Here's to hoping it gets fixed soon.

rfgdxm1

8:46 pm on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm a DMOZ editor and asked about this. The server load question was raised. Also, since then another problem with the idea occurred to me. We are having some *serious* problems with spammers sending automated submissions. Even to totally unrelated categories, such as my Recreation: Drugs one. Obviously, what they are hoping is that I'll be asleep at the switch and somehow add it when I shouldn't. Recreation: Drugs has a big, fat, juicy Google PR7 and spammers obviously would love a listing there. After deleting a bunch of spam yesterday from one spammer, they spammed my category again 2 more times today. If the DMOZ sends automated rejection notices, as soon as the spammer gets those they will know it is time to try, try again. This would not make life easier for the editors. If I am getting annoyed by the spam in my cat, I can only imagine what it must be like for the editors of commercial cats that are heavily spammed.

martinibuster

9:20 pm on Dec 3, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Wow, spammers!
I guess that's why other web sites oblige you to enter a code when submitting a web site.

I guess that's life in the new millenium.

victor

9:33 pm on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



As the person who started the "send an email" ball rolling, can I underline that I wrote:

[A]n "update and inform" button on the edit console along with the "update" button

Meaning that the editor has a choice of update-as-now or update-and-inform. Those with spammed cats might ignore the "inform" option.

Or, maybe given a bit of development, the "update-and-inform" button could exist only for certain cats -- such as those safe from spamming and seriously backlogged.

But as bird notes, nice ideas are not enough. DMOZ needs somes resource to make things happen.

Maybe we should have a collection to buy them a couple of week's work from a contractor :)

rfgdxm1

9:40 pm on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>Meaning that the editor has a choice of update-as-now or update-and-inform. Those with spammed cats might ignore the "inform" option.

Now this idea I like. I wouldn't mind that option for sites I approve. Also for some rejections. For example, I rejected one site and sent a brief e-mail myself the reason was that it was still underconstruction, and submitted to a totally wrong category. However, as for spammers sending them to the bit bucket is all I say they deserve. That same spammer just spammed my cat again in the last hour. :(

EliteWeb

9:40 pm on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I don't feel like arguing or even talking to the people who want a 100% SPECIFIC KEYWORD stuffed definition and I get them all the time, so letting them know then getting this communication process which is flawed I wouldnt want to deal with.

martinibuster

12:56 am on Dec 4, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Maybe we should have a collection

I know! A charity calendar to help defray the cost of updating dmoz!

Nick_W can pose on a bear skin rug with some css code tossed about in strategic places. . .

rfgdxm1

1:04 am on Dec 4, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>I don't feel like arguing or even talking to the people who want a 100% SPECIFIC KEYWORD stuffed definition and I get them all the time, so letting them know then getting this communication process which is flawed I wouldnt want to deal with.

You mean they weren't smart enough to demand that the keywords be stuffed in the anchor text as the name of the site? ;)