Forum Moderators: goodroi

Message Too Old, No Replies

Dmoz robots.txt

Is the dmoz.org/world disallowed?

         

angiolo

11:39 am on Aug 5, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I had a look at the dmoz.org robots.txt that is.

User-agent: *
Disallow: /cgi-bin/
Disallow: /editors/
Disallow: /World/.m

What does exactly mean /World/.m

I do not know what the /.m means!

Does it mean that all subdirectories are disallowed?
Does a link in the dmoz/world directories pass Page Rank?

bird

12:12 pm on Aug 5, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The /.m means any file or subdirectory within /World where the name starts with a dot and a lower case m character.

For example:

/World/.m
/World/.mystery.txt
/World/.mozzie/has/a/secret.html

etc...

angiolo

10:40 pm on Aug 5, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thank you for the clarification!

Does it have any sense in the Dmoz directory?

bird

8:05 am on Aug 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It is possible that the ODP uses files with names similar to ".mozsomething" for internal technical purposes, and doesn't want those indexed by the search engines. That's the most reasonable explanation I can think of without asking staff.