Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Using Allow: / in robots.txt

werty - 6:03 pm on May 19, 2003 (gmt 0)


Yeah I thought it was kind of strange that they had it on there. Everything I have seen mentioning robots.txt says it does not exist. Perhaps google has implemented the use of it?

I have no reason to use the allow, just thought I would point it out.

Thread source:: http://www.webmasterworld.com/robots_txt/15.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com