Welcome to WebmasterWorld Guest from

Forum Moderators: Webwork & skibum

Message Too Old, No Replies

Human edited VS Automatic editing

In the long run Human edited directories have to die

1:16 am on Oct 26, 2005 (gmt 0)

10+ Year Member

As technology improves, you can parse a website and get to know its service, context and area of interest etc in micro seconds and also with near perfect accuracy.

So far software solutions for this particular task are not that great, but will eventually improve.

Definitely human edited sites are good. So DMOZ, Joeant, skaffe services are good. But these services cannot do 100% job. There are millions of websites, thousands of cities, hundreds of countries, millions of different services. Simply put, humans can never even come closer to editing 10% of these websites.
100s of new sites take birth every day.

So, software solutions have to come to light to do this job. Search engines like google and yahoo already do that, but don't have better solutions. This is the only reason , why they rely on DMOZ.

Also, DMOZ/Joeant/Skaffe marketting mantra is, Human edited sites are always good. I agree with this, but they can never complete the task of adding all the sites.

In coming years DMOZ/Joeant/Skaffee will die under their own weight (lack of resources).

Search engines will have their own software solutions and will eventually phase out ODPs.

This is my opinion.

5:54 am on Oct 26, 2005 (gmt 0)

5+ Year Member

We have been hand editing our directories from day 1 - and decided a couple of years ago when presented with the opportunity to go "databased" that we would not...

Because most of our add to's are paid listings the workload is manageable... and our only real issue is "dead link cleaning".... which we try to do at least 2 times / year...

We find that human intervention is necessary to maintain quality of listing descriptions and to weed out poor quality site submissions.

Once technology is advanced enough to scrap the crap and write really good quality gramatically correct site descriptions on it's own we might upgrade... but I don't see that happening for at least 10-20 years... or more.

I think humans will always be in the loop where quality counts...

8:21 pm on Oct 27, 2005 (gmt 0)

10+ Year Member

why is this always an "either or" proposition? Humans can augment automation.. and automation can augment human efforts. Until we create "the singularity" -- I think humans and bots will just have to get along...
8:32 pm on Oct 27, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Simply put, humans can never even come closer to editing 10% of these websites.

If you are talking about the millions of websites that spring up through the automated activities of spammers and such like, then you have a point.

But then why would humans even want to consider such websites for a directory?

If you are suggesting that somehow humans can create websites 10 times faster than other humans can review them, I'd not with you. It akes *longer* to review a site that to create it? Is that what you are saying.

Afterall, I could argue that 1000s of hours of TV and radio programming is created every day.....Far too much for humans to absorb. Therefor we should invent machines to watch TV for us.

5:06 am on Oct 28, 2005 (gmt 0)

5+ Year Member

it just might be that only 10% of websites are actually worth listing...

and only humans can truely guage quality by direct reviewing...

so crawl the entire web - and sort it out by hand + some filters... with 1,000 employees reviewing 200 sites a day maybe it would take 2-3 years... now that's an information retrieval resource one might pay to use...

though I'd hate to see the employee turn over rate at a sweatshop like that... LoL - maybe that explains all the search companies outsourcing / moving to india and other places...

2:35 am on Nov 2, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

"Simply put, humans can never even come closer to editing 10% of these websites."

I think this is why niche directories are the way to go. Everyone (directory operator, included sites, and search engines) can be relatively sure that the sites in an honest niche directory are actually relevant to the directory's niche.

11:34 am on Nov 2, 2005 (gmt 0)

10+ Year Member

Yes, but as you say: "honest" directories. It's not easy to find a honest niche directory when you are new to a topic or - like a global search engine - are interested in many topics.

And - as you most likely know already - for every possible topic there are lots of small "directories" which are extremely dishonest. Either by just listing sites they are affiliated with, or by excluding noncommercial sites through listing fees.

5:23 pm on Nov 3, 2005 (gmt 0)

10+ Year Member

I have to disagree at least with Skaffe Directory dieing under its own weight. We can easily handle the submissions and increased submissions simply mean adding more resources to process the submissions. We have been in the directory business for quite some time and have a fast and efficient submission processing system with plenty of room for expansion.

WoW Directory I have set up very similar. The majority of the submissions are free submissions and lots of them but we get all accepted submissions processed within what I consider a reasonable period of time. Normally within two weeks and frequently much less. WoW also has plenty of room for expansion.

5:35 pm on Nov 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

There is clustering technology. It's sort of similar to directories.

Featured Threads

Hot Threads This Week

Hot Threads This Month