Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Disallow: /*? - is it ok ?


jimbeetle - 3:13 pm on Oct 9, 2008 (gmt 0)


Just be sure you know exactly what you want to do here. Robots.txt is used to block spiders from URLs on your site. They will still follow outgoing links unless the pages on your site on which the links appear are blocked.


Thread source:: http://www.webmasterworld.com/robots_txt/3761096.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com