Welcome to WebmasterWorld Guest from 54.82.29.141

Forum Moderators: goodroi

Message Too Old, No Replies

Why Google is following my links?

     
7:09 pm on Mar 2, 2009 (gmt 0)

Full Member

5+ Year Member

joined:Jan 29, 2008
posts:243
votes: 0


I've following links blocked in my robots.txt:
User-agent: *
Disallow: /tools/email.php
Disallow: /tools/print.php
Disallow: /tools/save.php
Disallow: /*?
Sitemap: http://www.example.com/sitemap.xml.gz

On each page email link is as follows:

<a href="/tools/email.php?aid=100" rel="nofollow">Email this page to a friend</a>

But log shows that Google and other search engines are still following the links. Am I doing something wrong here?

TIA

1:37 pm on Mar 3, 2009 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3328
votes: 246


Your robots.txt should be blocking these urls:
http://www.example.com/tools/email.php
http://www.example.com/tools/email.php?aid=100

It will allow Google to access a url like this:
http://www.example.com/red/tools/email.php

Also please remember that rel="nofollow" was not intended to restrict robot access (even though it is called nofollow). Its purpose is to identify untrusted links to Google.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members