Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Spiders get / and /robots.txt but no more!
engine - 7:18 pm on Dec 11, 2003 (gmt 0)
>#Email editor@MyDomain.com with any questions. I'd remove that to help cut back on e-mail spam.
Thread source:: http://www.webmasterworld.com/robots_txt/217.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com