Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- robots.txt


copongcopong - 11:07 pm on Jun 1, 2003 (gmt 0)


Well we have a perfect .htaccess ban list at:

[webmasterworld.com...]

How about a disallow spider list?


Thread source:: http://www.webmasterworld.com/robots_txt/8.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com