Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt


Macguru - 3:48 pm on Jan 2, 2001 (gmt 0)


Hi WebSeeker,

I use this file mainly to disalow access to some robots, files or folders. Also to cut down on thoses 404 Errors.


Thread source:: http://www.webmasterworld.com/robots_txt/146.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com