Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Global "no follow" and discretionary "follow"


dummiped - 7:23 pm on Jan 14, 2009 (gmt 0)


Hi, I just found out that Wikipedia implements "no follow" because of the existence of deadlinks (red links) due to internal hyperlinking.

As my website is also using the Mediawiki software like Wikipedia and since it is a one-year old site with a lot of deadlinks (red links), I wonder whether I can have a global "no follow" in the robot.txt file, followed by the following:

<meta name="Robots" content="index,follow">

on each article page, as soon as I manage to clear all the red links for each page.


Thread source:: http://www.webmasterworld.com/robots_txt/3826358.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com