Forum Moderators: open

Message Too Old, No Replies

Google - DMOZ cooperation suggestion

Theme Change Notification

         

rogerd

3:25 pm on Nov 14, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Lately, there has been a lot of discussion about DMOZ flaws, and quite a bit about domain hijacking. Porn sites and cheesy search functions grab expired domains and set up shop, hoping that visitors will show up via bookmarks, links, and searches. Many of these sites maintain fairly decent PR, probably because of past linkage (including DMOZ and Yahoo).

While DMOZ bears the brunt of the criticism for listing hijacked domains in their old categories, they are ill-equipped to address this issue. The DMOZ spider is rudimentary at best - the only way for DMOZ to address this issue is for each editor to click on all their links. With most editors being hopelessly overworked, and many cats having no permanent editor at all, this simply isn't going to happen.

So, here's the suggestion - Google DOES have sophisticated spidering and content analysis. What if, once a month, Google matched sites listed in the Google Directory with sites that showed a major change in content - it could be a theme change, a complete change in page names, etc. These sites could be flagged in the DMOZ editor's view as "Major Content Change", just like the sites flagged as being unresponsive by Robozilla.

Many of these flagged changes would be benign, of course - a major site redesign, a switch to dynamic content, etc., in which case the editor could clear the flag. In those cases where a true change in content has occurred, the editor could delete the site if it was now spam, or move it to the correct category.

This would require some programming work on both ends, but it might serve both firm's needs - a better DMOZ means a better Google Directory. (The same approach could work for Google and Yahoo, I suppose, although Google has less motivation to improve the Yahoo directory.)

nvision

3:30 pm on Nov 14, 2002 (gmt 0)

10+ Year Member



It would help if DMOZ updated its own category listings more frequently - specially when deleting directories and moving content around - Google's dropped a few sites I know of because of this and it's quite frustrating to have to wait for DMOZ to ammend these changes for Google to then pick them up.

On that note, how often does DMOZ update its category modifications? :¦

Liane

3:41 pm on Nov 14, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



While your suggestion has a lot of merit rogerd, I can't see why it is the ODP's or Google's responsibility to be the dead or changed URL police? I feel it is up to the webmaster community to clean up the messes we create.

A friend of mine recently had his URL hijacked when it lapsed. (He was away on vacation). I set up a new URL for him, had a site built and up and running within a few weeks. I then systematically informed everyone who had been linking to his old domain that the URL had been hijacked and was now in the hands of a spammer based in India.

Without exception (including ODP), every one of those with links to his old site changed it to the new URL. Problem solved!

rogerd

3:47 pm on Nov 14, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Liane, congrats on your successful switchover. However, I don't think many site owners will be as diligent as you and your friend. Probably most expired domains converted to spam sites lapsed because the original owners had lost interest and simply abandoned them. Even those site owners that are still active may not fully understand how to track down directory listings and links.

jackofalltrades

3:50 pm on Nov 14, 2002 (gmt 0)



>I can't see why it is the ODP's or Google's responsibility to be the dead or changed URL police?

If it is one web designers responsibilty to maintain the quality of their site, then it is all our responsibility.

The web teams behing Google, ODP and all the other big names have the same responsiblity as the rest of us for maintaining the quality of their sites.

Its just that the big players have the $$$$ to do it on a larger scale.

JOAT :)

rogerd

4:07 pm on Nov 14, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



One other point on responsibility - I don't think it is really the site owner's responsibility to keep the DMOZ/Google directory listing up to date. Many sites are added to the database by editors themselves, and the site owner has no input into or awareness of the original listing. The responsibility of maintaining each category is that of the category editor. (Having said that, I must also admit that I'm a category editor, and I don't click on every existing listing on a regular basis. I do some spot checks, but just don't have the time for a monthly sweep.)

Liane

4:14 pm on Nov 14, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



most expired domains converted to spam sites lapsed because the original owners had lost interest and simply abandoned them.

Point made rogerd, and I do think your suggestion has merit. However, I still believe there are a lot of scooped/hijacked domains that we do know about and I would hazzard a guess that it amounts to a great many URL's.

Perhaps we can all help one another and at the same time lessen ther load for the ODP and Google by cleaning up what we can by reporting those we find to the proper sources. It would be simple for the ODP and Google to add a "dead or hijacked link" to each category in the directories.

When we stumble across one, shoot the "trash" report to either or both of them!

rogerd

4:23 pm on Nov 14, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



I have to agree with you on that score, Liane - an easy reporting mechanism (probably to the DMOZ editor chain) would be a good step. Google really doesn't want to deal with manual site reviews, I'm sure. But I could definitely see a "hijacked/changed site complaint" flag being helpful to editors.

bird

5:18 pm on Nov 14, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just submit a "change request". Those carry a special flag in the queue for the editors, and will typically be processed before the other submissions. Fortunately, the fact that a domain was hijacked is easy to verify once it is brought to someones attention.

<added>Of course, if you have more than a handful of URLs to report, it's probably better to send the list directly to one of the meta editors per editor feedback, which will simplify the task on both ends.</added>