Forum Moderators: open

Message Too Old, No Replies

history of Google refreshing from DMOZ?

previous thread?

         

amznVibe

7:01 am on Nov 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I can't seem to find a previous thread with the history of dates of Google updating from DMOZ. Is there one?

Last DMOZ RDF was January 31st? Is that possible? Nothing newer?
And when did Google finally pickup the January RDF?

Either the WW Directory library is hurting or I am not searching hard enough...

Thanks for any info!

cbpayne

9:30 am on Nov 1, 2003 (gmt 0)

10+ Year Member



DMOZ prepare an rdf dump weekly .... Google used to take that monthly, but has not done so for >6-7 months. No one know why.

windharp

11:24 am on Nov 1, 2003 (gmt 0)

10+ Year Member



On [rdf.dmoz.org...] you can see that the last RDF build was this week.

Smeone may correct me if I am wrong - but I don't know of any project logging the dates Google took the RDF-File.

amznVibe

11:40 am on Nov 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm searching around for dates in previous discussions.

I think there was an update on or around March 7-9th 2003 but can't find a mention after that. Wow.
Twice a year at best? Is it just difficult for Google or they could care less?

(also for anyone making a list, earlier update around May 26-28th 2002)

Mohamed_E

12:22 pm on Nov 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Is it just difficult for Google or they could care less?

Almost certainly the latter.

Directories see the web as a collection of sites, Google sees it as a collection of pages. I suspect that Google, like many users, considers directories a relic of the past.

rfgdxm1

1:53 pm on Nov 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>Directories see the web as a collection of sites, Google sees it as a collection of pages. I suspect that Google, like many users, considers directories a relic of the past.

A relic Google links to on their *home page*. This publicly reflects poorly on Google.

willybfriendly

5:02 am on Nov 2, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I don't know the last time Google updated their directory from DMOZ. It seems to me though that at one time DMOZ had a PR of 10, and it is only a PR9 now. I also note that the cat my site is listed in has lost at least a PR of 2 from what it used to be.

Conclusion - DMOZ is less important in more ways than one.

WBF

victor

7:35 am on Nov 2, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Looks like it is updating right now:

[webmasterworld.com...]

Maybe someone could start a history. We've now got, approxiamtely:

  • Feb-2003
  • Nov-2003
  • amznVibe

    9:42 am on Nov 2, 2003 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    more like

  • late May 2002
  • early March 2003
  • early November 2003

    (still not seeing any update though in dmoz for 2 newer listings, but I'll have faith it's coming shortly)

    I'm searching for any other updates in early or late 2002 but I can't seem to find a mention.

  • victor

    11:11 am on Nov 2, 2003 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Nice start, AmznVibe.

    The URL I listed in message 8 has vanished -- the thread has been deleted, it seems, in favor of:

    [webmasterworld.com...]

    caine

    11:23 am on Nov 2, 2003 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    it was every month though sometimes a little longer, it certainly has been a while since G downloaded the rdf to update its own directory.

    The problem lie's certainly over the last 6 months, with all the problems that the ODP servers were having, it disrupted the feed. Now that they have sorted it out, i'm waiting anxiously to see when they update, as its a long time coming, and i think it will have an effect in some industries.

    g1smd

    4:29 pm on Nov 2, 2003 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



    >> The problem lies certainly over the last 6 months, with all the problems that the ODP servers were having, it disrupted the feed. <<

    No it did not disrupt the feed. The RDF has been built just about every week since about March this year, with very few exceptions. There were a few times that that the file had a few invalid XML sequences scattered in them due to some character encoding issues, but the RDF has generally been available for the last 6 months. The RDF is stored on a separate server to the rest of the ODP. The RDF server was just about the first thing that was upgraded in the six months of work that was done on the ODP infrastructure. The editing servers were next, then the internal forums, and lastly the public servers.

    .

    The Google Directory is now showing the first major update in over 6 months.

    A new ODP category, which was created in 2003 May is now included in the Google Directory on directory-ex.google.com for the very first time. The category has been showing in Google SERPs from about 2003 July onwards, but clicking the link went to a "this category does not exist or has moved" error message. Whatever problems Google were having with the data appears to now be fixed.

    The new directory is also showing up in directory-in.google.com.

    The old version is still showing at -va, -ab, and -dc.

    The domains at -fi and -cw are not responding at all. The browser just hangs, waiting.

    There is no directory at -zu, -sj, -gv, -mc or -kr.

    What is the date of the latest ODP changes that are showing in the new -ex and -in directory?

    amznVibe

    4:55 pm on Nov 2, 2003 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Whatever they are doing now, it's definitely not a complete match to dmoz.

    Two sites I have newly listed in dmoz (for 2 months now) are not in the Google directory (on any of the supposedly updated datacenters) and they do not have an extended url tag in the regular search showing a directory path).

    Still waiting patiently ;)

    ADDED: aha! Didn't realize I had listings in multiple categories...
    Google chose one and not the other... definite update on directory-in.google.com

    rfgdxm1

    7:00 pm on Nov 2, 2003 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    >No it did not disrupt the feed. The RDF has been built just about every week since about March this year, with very few exceptions. There were a few times that that the file had a few invalid XML sequences scattered in them due to some character encoding issues, but the RDF has generally been available for the last 6 months. The RDF is stored on a separate server to the rest of the ODP. The RDF server was just about the first thing that was upgraded in the six months of work that was done on the ODP infrastructure. The editing servers were next, then the internal forums, and lastly the public servers.

    Right. Many months ago there was a time when the ODP hadn't done an RDF update for a long time. However, that was long fixed. The blame for Google not updating the directory since then lies with Google.

    John_Caius

    12:36 pm on Nov 3, 2003 (gmt 0)