Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Why Google is following my links?



7:09 pm on Mar 2, 2009 (gmt 0)

5+ Year Member

I've following links blocked in my robots.txt:
User-agent: *
Disallow: /tools/email.php
Disallow: /tools/print.php
Disallow: /tools/save.php
Disallow: /*?
Sitemap: http://www.example.com/sitemap.xml.gz

On each page email link is as follows:

<a href="/tools/email.php?aid=100" rel="nofollow">Email this page to a friend</a>

But log shows that Google and other search engines are still following the links. Am I doing something wrong here?



1:37 pm on Mar 3, 2009 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Your robots.txt should be blocking these urls:

It will allow Google to access a url like this:

Also please remember that rel="nofollow" was not intended to restrict robot access (even though it is called nofollow). Its purpose is to identify untrusted links to Google.


Featured Threads

Hot Threads This Week

Hot Threads This Month