Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Global "no follow" and discretionary "follow"

7:23 pm on Jan 14, 2009 (gmt 0)

New User

5+ Year Member

joined:Jan 14, 2009
posts: 1
votes: 0

Hi, I just found out that Wikipedia implements "no follow" because of the existence of deadlinks (red links) due to internal hyperlinking.

As my website is also using the Mediawiki software like Wikipedia and since it is a one-year old site with a lot of deadlinks (red links), I wonder whether I can have a global "no follow" in the robot.txt file, followed by the following:

<meta name="Robots" content="index,follow">

on each article page, as soon as I manage to clear all the red links for each page.

2:34 pm on Jan 15, 2009 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
votes: 195

I do not know about mediawiki but I do know that robots.txt can not apply nofollow to links. Robots.txt is a voluntary protocol that helps webmasters tell robots which files and folders should be accessed and which should not be accessed. If you block a file using robots.txt the search engine bots will not access it so they will not see the individual robots meta tag.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members