Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
WebSeeker - 2:14 pm on Jan 2, 2001 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/146.htm
Do you use Robots.txt if you want to allow all robots from all engines? Or is it only used when you want to disallow something?
Brought to you by WebmasterWorld: http://www.webmasterworld.com