Open Directory RDF Dump

[SlowMove]

Any opinions on the value of adding dmoz data to a site? I tried adding ODP data to a site but it didn't add any additional pages to the site. From checking backlinks to sites that are listed in dmoz, it seems google and the other engines don't always index the pages of other sites using the directory data.

Also, if it is worth it, what's the best way to parse the data?

[edited by: skibum at 6:50 am (utc) on July 1, 2003]
[edit reason] no site specifics please [/edit]

[rogerd]

Google considers copies of DMOZ data to be duplicate content, and usually won't index those pages. Their filters haven't always worked at 100%, though.

[SlowMove]

>>Google considers copies of DMOZ data to be duplicate content

are there other places to get free content that would be difficult for google to detect as duplicate?

[g1smd]

Just to let you all know that you should be using only [rdf.dmoz.org...] to get copies of the RDF dump.

Older addresses at [directory.mozilla.org...] and [dmoz.org...] are no longer in use.

The latest RDF data is usually available weekly at [rdf.dmoz.org...] these days.

[rfgdxm1]

>Google considers copies of DMOZ data to be duplicate content, and usually won't index those pages.

Notable exception: the Google Directory.

[rafalk]

are there other places to get free content that would be difficult for google to detect as duplicate?

Why don't you use the ODP data as a starting off point and add to it? That's unique content.