Page is a not externally linkable
jdMorgan - 3:02 am on Nov 5, 2003 (gmt 0)
May I suggest: User-agent: * Ref: [robotstxt.org...] The robots.txt validator -- like most other validators -- indicates that the 'code' is valid, and not that it will do what you desire it to do. Disallowing /xyz.php will also disallow /xyz.php?anything Jim
roddy,
Disallow: /privmsg.php
Disallow: /search.php
Disallow: /faq.php
Disallow: /memberlist.php
Disallow: /groupcp.php
Disallow: /profile.php
Disallow: /login.php
Disallow: /posting.php
Disallow: /viewonline.php