Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt Question :)

Prana - 10:34 pm on Sep 26, 2003 (gmt 0)


Thanks Jim,

You fast assistance and links are highly appreciated.

Out of curiosity if I LEFT OUT the part you noted
***The robots.txt should have a space after the ":" ***

Would ALL the pages on website be spiderable?

Once again..... Sincere Thanks :)

Thread source:: http://www.webmasterworld.com/robots_txt/9.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com