Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
The current state of the ODP directory (which you see and Google spiders) is retrograde, even more out of date than it was last month (due to public pages having been moved to a different server, and the page update process changed.) So Google SEARCH could have spidered a more recent dmoz.org page than you can see. And Google DIRECTORY picks up from the RDF, which will have yet a different date on it.
Everyone's moving forward, just not in lockstep. If a site goes into (out of) the ODP, eventually Google will fully represent its new status. "Exactly when?" Who knows, given the current hardware/software flux.
They are for sites added to the ODP in mid to late April, or very early May, but the sites do not actually appear in the Google Directory if you click the link.
Looks like Google are waaay behind with their update. The ODP as been churning out the data every week; but Google still have a very old copy and aren't doing a lot with it.
A few odd things - doing a search at Google on my site showed the ODP listing (then and now).
Prior to the DMOZ server upgrade (and we're talking days here) - I could only find my site listed if I went to [dmoz.com...] - it could not be found if you went to www.dmoz.com, dmoz.org, or www.dmoz.org
Now that the upgrade is complete I can not see my site on any of the 4 url variations above. However, if I enter my site into the search box at DMOZ, it finds the listing for it (though the category it says it is in, still isn't showing it).
So... what I'm thinking at the moment, is that google crawled the dmoz site just prior to the upgrade (and got the most current listing), but dmoz itself hasn't got the latest version of the data yet (I read somewhere that they were using a version of the directory from June or something while they were updating the new servers)... sounds like we just need to wait a little while for everything to transfer across after their new server upgrades.
what I'm thinking at the moment, is that google crawled the dmoz site just prior to the upgrade
Umm, no. The editors now have a separate server to that seen by the public. The public side was split away from the editing side at the beginning of July in preparation for upgrading the editing servers. The public side was loaded with data from early or mid June, hence suddenly having older data. The edit side had the current data, and has been edited and updated all the time; except for the 6 days that the server was off offline and the data transferred to new machines. The public side still shows the very old data, but that will be replaced with the data from the edit server in the next few days.
The reason for seeing different data at different domains is that some redirected to the edit side, and others to the public side. All domains that the public can access should now be redirected to the (currently old) public data. You'll see that data update in a day or two.
Maybe I'm not following something.
If I look up my category in dmoz.org and the exact same category in the Google directory, my site and one other new site are present in dmoz but missing from Google.
Are you saying that the dmoz publicly viewable directory will update in a day or two or that the Google directory will update shortly?
Sorry for being so thick headed.
Only Google knows when they decide to update their directory with the ODP dump (or if anybody knows, please feel free to tell *gg*). But I think there's a good chance this will happen soon.
The content at Google directory is older than the public one of the ODP, so your site is not in Google directory, yet.
Google update their directory from the RDF file that the ODP produces weekly. They haven't updated for many months. They do it when they feel like it.
Google appear to be starting to use data that the ODP produced in May. So far only category links are appearing in search engine results, the actual Google directory data itself is very old.