Welcome to WebmasterWorld Guest from 54.163.68.15

Forum Moderators: goodroi

Message Too Old, No Replies

Why Google is following my links?

   
7:09 pm on Mar 2, 2009 (gmt 0)

5+ Year Member



I've following links blocked in my robots.txt:
User-agent: *
Disallow: /tools/email.php
Disallow: /tools/print.php
Disallow: /tools/save.php
Disallow: /*?
Sitemap: http://www.example.com/sitemap.xml.gz

On each page email link is as follows:

<a href="/tools/email.php?aid=100" rel="nofollow">Email this page to a friend</a>

But log shows that Google and other search engines are still following the links. Am I doing something wrong here?

TIA

1:37 pm on Mar 3, 2009 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Your robots.txt should be blocking these urls:
http://www.example.com/tools/email.php
http://www.example.com/tools/email.php?aid=100

It will allow Google to access a url like this:
http://www.example.com/red/tools/email.php

Also please remember that rel="nofollow" was not intended to restrict robot access (even though it is called nofollow). Its purpose is to identify untrusted links to Google.