homepage Welcome to WebmasterWorld Guest from 54.167.75.155
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Querystring check
papamaku




msg:1526176
 5:52 pm on Nov 1, 2004 (gmt 0)

Is it possible to give Google + co a NoIndex if the url loaded has a certain parameter in the querystring? E.g.

www.domain.com/index.php - is fine and wants to be indexed

www.domain.com/index.php?aff=123456 - block any indexing of pages with any 'aff' in the querystring

I want to do this as G has penalised one of my sites for duplicate contact due to inbound links to the same index.php page but just with different affiliate ids.

 

papamaku




msg:1526177
 9:36 am on Nov 2, 2004 (gmt 0)

In these threads:

[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]

People suggest using RegEx for googlebot only, however no-one seems to give a final confirmation that it works for blocking select querystrings.

Can anyone confirm that this will work:

User-agent: Googlebot
Disallow: /index.php?aff=*$

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved