Welcome to WebmasterWorld Guest from 50.16.112.199

Forum Moderators: goodroi

Why Google is following my links?

   
7:09 pm on Mar 2, 2009 (gmt 0)

5+ Year Member



I've following links blocked in my robots.txt:
User-agent: *
Disallow: /tools/email.php
Disallow: /tools/print.php
Disallow: /tools/save.php
Disallow: /*?
Sitemap: http://www.example.com/sitemap.xml.gz

On each page email link is as follows:

<a href="/tools/email.php?aid=100" rel="nofollow">Email this page to a friend</a>

But log shows that Google and other search engines are still following the links. Am I doing something wrong here?

TIA

1:37 pm on Mar 3, 2009 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Your robots.txt should be blocking these urls:
http://www.example.com/tools/email.php
http://www.example.com/tools/email.php?aid=100

It will allow Google to access a url like this:
http://www.example.com/red/tools/email.php

Also please remember that rel="nofollow" was not intended to restrict robot access (even though it is called nofollow). Its purpose is to identify untrusted links to Google.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month