Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Hiding robots.txt

ThierryZoller - 10:39 pm on Nov 1, 2003 (gmt 0)


User-agent: *
Disallow: /m
Disallow: /st

This is going to disallow
/mofo.html
/moritis.htm
/strange.htm
/stupi.html

Better use :
Disallow: /m/
Disallow: /st/

For directories.

Thread source:: http://www.webmasterworld.com/robots_txt/74.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com