Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- using robots.txt


markgibson77 - 11:53 am on Jul 13, 2006 (gmt 0)


Can anyone tell me if its better to disallow my .php include files from search engines spiders? I have been told that Google does not like seeing two pages with exactly the same instances. Is this correct?


Thread source:: http://www.webmasterworld.com/robots_txt/937.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com