Forum Moderators: open

Message Too Old, No Replies

Updation of Dmoz results

Is dmoz slow

         

asomani

3:50 am on Oct 17, 2002 (gmt 0)

10+ Year Member



Dear Forum members,

I need some information.

My site got accepted in two categories of dmoz more than a month ago. But still if i search with the domain name, i can not find it.

Not only this I feel google has not also updated its directory since then. I am in dmoz directory, but not i n search results of dmoz nor in the google directory. But I got accpeted more t han a month back.

fathom

6:00 am on Oct 17, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Be patience, DMOZ is conducting a major maintainence overhaul of their backend software.

asomani

4:51 am on Oct 18, 2002 (gmt 0)

10+ Year Member




Ok.
Thanks. You have any idea about its effect on the search results.

fathom

5:53 am on Oct 18, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



None - with exception of maybe a delay in RDF dumps to Google Directory and clone sites.

g1smd

9:05 pm on Oct 18, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




The ODP search database is updated about once per week, but with recent down-time there have been some gaps in that schedule.

The data forming the ODP is dumped into an RDF file also about once per week. This has also been clobbered by the down-time on a few occasions.

The RDF dump is picked up by other directories and used to seed their own on a random timescale. Google drops by every month or so, but sometimes misses picking up, or perhaps the dump from the previous time is still in place.

I would say to allow 2 to 3 weeks to appear in dmoz search, after being listed in the directory, and another 2 to 3 months to appear in the Google directory (and/or Google search).

Some sites out there are still using copies of the RDF dump that they took 3 or more years ago, and which they have never updated.

Quadrille

1:35 pm on Oct 21, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Once upon a time, editors could 'force' an update of the public page of a category, after editing; that no longer works, and the updating by the the 'system' has slipped badly.

Two to three weeks has become 5-6 (and more!), while the data dump has been unavailable for Google on more than one occasion.

I'm all for overhauling the tired, over-tweaked system that is the ODP back end ... but I'm seriously worried about the time scale. If the system is not restored soon, I suspect Google will start looking around for alternative sources of free (or subsidized) listings. :(

Mind you, maybe they had the sense to go to Google first, and say "Bear with us for six months". But I'd not bet on that.

steveb

1:53 pm on Oct 23, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm confused. At dmoz I see:
"Search database last updated on: Sat Sep 28 00:54:00 PDT 2002"

Nearly a month, people are saying this usually only takes a week?

At the same time, are sites that have been "accepted" not being shown on the category pages yet?

Put another way... editor looked at a site of mine yesterday. If approved, how long before I would I normally be able to see it on the category page?

g1smd

6:55 pm on Oct 23, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The HTML pages that the Public views are static pages, based on a snapshot of that category, taken after the last edit. When an editor 'publishes' your site entry, he is making a change in a database. The public page HTML is regenerated after each edit, so if there is nothing else in the Page Regeneration Queue then it will only be a few seconds. In practise, Page Regeration takes anything from 5 minutes to several hours. However, at the present time, I believe that PR has been stopped for a few days due to effects of recent downtime, and the need to generate a good RDF dump, the last 3 or 4 attempts at a good dump having been clobbered by random problems and the recent downtime.

As for the 'last updated' date on the search facility, I thought that I already answered that in the post above. It normally is done at least weekly, but at this time, due to recent system downtime it has not been done for three weeks. At least the search results do have a 'Last Updated' date on them to flag up exactly what you are working with. There are some sites out there that are displaying ODP data that hasn't been updated for over three years, but unless you are familiar with the site listings, you would never know because there is no 'last updated' date on any of those pages.