Forum Moderators: goodroi

Message Too Old, No Replies

How to block tags?

hundreds of undesired links !

         

rashe18

3:31 pm on Aug 31, 2007 (gmt 0)

10+ Year Member



Hello.

Today i checked my wordpress blog in google and there is hundreds of links like this:

----------------------------------------
www.site-name.com/index.php?tag=keyword
----------------------------------------

keyword= different keywords i add to the posts using the ultimate tag warrior plugin.

I have a robots.txt file but i could not find how to block search engines from generating these links.

Can you help me?

thnX

goodroi

12:50 pm on Sep 4, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



The official robots.txt protocol does not provide for wildcard url matching. The big search engines have added this functionality to their bots (the smaller ones haven't). If you are worried only about Google or Yahoo you can use wildcards aka pattern matching. This will allow you to block any url that contains "php?tag=" IMPORTANT This is not supported by most other bots.

Google Robots.txt Pattern Matching Explained
[google.com...]

Yahoo Robots.txt Wildcards Explained
[ysearchblog.com...]

rashe18

4:33 pm on Sep 4, 2007 (gmt 0)

10+ Year Member



Done through robots.txt:

-----------------
Disallow: /*tag=
-----------------

I hope this resolve the problem.

Thanks for your reply.