Page is a not externally linkable
-- New To Web Development
---- How does a spider see all my pages?
SmallTime - 10:49 am on Dec 11, 2002 (gmt 0)Thread source:: http://www.webmasterworld.com/new_web_development/206.htm
I use a robots.txt file to dissallow any folders I don't want them to spider. I do not use a meta robots tag on the page.
Brought to you by WebmasterWorld: http://www.webmasterworld.com