Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Put your robots.txt on a diet
bcolflesh - 1:51 pm on Jun 13, 2003 (gmt 0)
A lot of people download the grub client and use it for less than altruistic purposes... Regards,
Brent
Thread source:: http://www.webmasterworld.com/robots_txt/3.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com