Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt


WebSeeker - 2:14 pm on Jan 2, 2001 (gmt 0)


Do you use Robots.txt if you want to allow all robots from all engines? Or is it only used when you want to disallow something?


Thread source:: http://www.webmasterworld.com/robots_txt/146.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com