DMOZ and Netscape?

dirt.netscape.com takes me to ODP.....

[kstprod]

I found the following in my server logs...

dirt.netscape.com - - [01/Nov/2002:08:28:12 -0500] "GET / HTTP/1.0" 206 8115 "-" "libwww-perl/5.51"

When I visit [dirt.netscape.com...] it takes me to dmoz.org. What's up with that? Is one owned by the other or something? This is the only file they retrieved and oddly got a 206 code, but got the whole page because it actually is 8115 in size.

I submitted to dmoz a couple weeks ago, but not listed yet. Does this mean they're checking me out?

[choster]

ODP is funded by Netscape (see also the announcement [dmoz.org] of the relationship). That is, ODP servers and bandwidth are provided by Netscape, and its paid staff members are employees of AOLTW.

For all intents and purposes,

dmoz.org = directory.mozilla.org = dirt.netscape.com = newhoo.com = gnuhoo.com

As to what this means about your listing: possibly everything and possibly nothing. It could be an editor checking the url for notes, it could be an add or deletion or move.

[kstprod]

Ok, thank you!

One more thing...should I be concered with them getting a 206 code? I just checked logs again, and I have 2 entries like the one above (19 seconds apart), but only requesting the one page, not even any of the images. They are getting 206's also.

[choster]

If the site is already listed in the ODP, it could be the automated internal link rot checker, Robozilla, visiting the site to make sure it's still there.

I do not know enough about either HTTP or Robozilla to say why you would receive 206 codes. But since Robozilla is mainly looking for 301, 4xx, and 5xx errors (which would indicate that a resource is moved or unavailable), perhaps it only requests the first x number of bytes to save bandwidth, hence the partial content code returned?

[kstprod]

My site isn't listed yet, so I wouldn't think that was it. That makes 3 today, so I just don't know. I do know this, it's bugging the crap outta me, because I'm very anxious to get in there....lol

Do you know what this part means?

"libwww-perl/5.51"

[choster]

"libwww-perl/5.51" is the reported user agent, i.e. the software that is being used to make the requests, like "MSIE" or "Googlebot." In this case, I would guess it is a robot built using the indicated Perl module.

Robozilla may be checking unreviewed submissions in addition to urls already published in the directory.

[korkus2000]

Robozilla does check sites in the unreviewed queue. Although I would think it would say robozilla and not libwww-perl/5.51. They could be upgrading robozilla though. They have been upgrading a lot lately.

Here is more info on dmoz editors and server logs.
[webmasterworld.com...]