homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Directories
Forum Library, Charter, Moderators: Webwork & skibum

Directories Forum

Human edited VS Automatic editing
In the long run Human edited directories have to die

 1:16 am on Oct 26, 2005 (gmt 0)

As technology improves, you can parse a website and get to know its service, context and area of interest etc in micro seconds and also with near perfect accuracy.

So far software solutions for this particular task are not that great, but will eventually improve.

Definitely human edited sites are good. So DMOZ, Joeant, skaffe services are good. But these services cannot do 100% job. There are millions of websites, thousands of cities, hundreds of countries, millions of different services. Simply put, humans can never even come closer to editing 10% of these websites.
100s of new sites take birth every day.

So, software solutions have to come to light to do this job. Search engines like google and yahoo already do that, but don't have better solutions. This is the only reason , why they rely on DMOZ.

Also, DMOZ/Joeant/Skaffe marketting mantra is, Human edited sites are always good. I agree with this, but they can never complete the task of adding all the sites.

In coming years DMOZ/Joeant/Skaffee will die under their own weight (lack of resources).

Search engines will have their own software solutions and will eventually phase out ODPs.

This is my opinion.



 5:54 am on Oct 26, 2005 (gmt 0)

We have been hand editing our directories from day 1 - and decided a couple of years ago when presented with the opportunity to go "databased" that we would not...

Because most of our add to's are paid listings the workload is manageable... and our only real issue is "dead link cleaning".... which we try to do at least 2 times / year...

We find that human intervention is necessary to maintain quality of listing descriptions and to weed out poor quality site submissions.

Once technology is advanced enough to scrap the crap and write really good quality gramatically correct site descriptions on it's own we might upgrade... but I don't see that happening for at least 10-20 years... or more.

I think humans will always be in the loop where quality counts...


 8:21 pm on Oct 27, 2005 (gmt 0)

why is this always an "either or" proposition? Humans can augment automation.. and automation can augment human efforts. Until we create "the singularity" -- I think humans and bots will just have to get along...


 8:32 pm on Oct 27, 2005 (gmt 0)

Simply put, humans can never even come closer to editing 10% of these websites.

If you are talking about the millions of websites that spring up through the automated activities of spammers and such like, then you have a point.

But then why would humans even want to consider such websites for a directory?

If you are suggesting that somehow humans can create websites 10 times faster than other humans can review them, I'd not with you. It akes *longer* to review a site that to create it? Is that what you are saying.

Afterall, I could argue that 1000s of hours of TV and radio programming is created every day.....Far too much for humans to absorb. Therefor we should invent machines to watch TV for us.


 5:06 am on Oct 28, 2005 (gmt 0)

it just might be that only 10% of websites are actually worth listing...

and only humans can truely guage quality by direct reviewing...

so crawl the entire web - and sort it out by hand + some filters... with 1,000 employees reviewing 200 sites a day maybe it would take 2-3 years... now that's an information retrieval resource one might pay to use...

though I'd hate to see the employee turn over rate at a sweatshop like that... LoL - maybe that explains all the search companies outsourcing / moving to india and other places...


 2:35 am on Nov 2, 2005 (gmt 0)

"Simply put, humans can never even come closer to editing 10% of these websites."

I think this is why niche directories are the way to go. Everyone (directory operator, included sites, and search engines) can be relatively sure that the sites in an honest niche directory are actually relevant to the directory's niche.


 11:34 am on Nov 2, 2005 (gmt 0)

Yes, but as you say: "honest" directories. It's not easy to find a honest niche directory when you are new to a topic or - like a global search engine - are interested in many topics.

And - as you most likely know already - for every possible topic there are lots of small "directories" which are extremely dishonest. Either by just listing sites they are affiliated with, or by excluding noncommercial sites through listing fees.


 5:23 pm on Nov 3, 2005 (gmt 0)

I have to disagree at least with Skaffe Directory dieing under its own weight. We can easily handle the submissions and increased submissions simply mean adding more resources to process the submissions. We have been in the directory business for quite some time and have a fast and efficient submission processing system with plenty of room for expansion.

WoW Directory I have set up very similar. The majority of the submissions are free submissions and lots of them but we get all accepted submissions processed within what I consider a reasonable period of time. Normally within two weeks and frequently much less. WoW also has plenty of room for expansion.


 5:35 pm on Nov 3, 2005 (gmt 0)

There is clustering technology. It's sort of similar to directories.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Directories
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved