Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Correctly disallowing only parts of a folder


Trax - 10:14 am on Aug 13, 2009 (gmt 0)


In my robots.txt I copied a line from another site that i thought applied to mine as well because the idea is the same

I have a dynamic page that has 100s of links looking like this:
.com/widget-something/?category=something1&page=&text=0
.com/widget-something/?category=something2&page=&text=0
...

Now i ONLY want .com/widget-something/ to show in google
when linking to .com/widget-something/?category=something1&page=&text=0 i want the link juicy just to go towards .com/widget-something/ and not the specific URL

So i added this to the robots.txt

User-agent: *
Disallow: /widget-something/?

Is that wrong? Google wembaster tools says I am blocking /widget-something/

What am I doing wrong? How should it be done correctly?


Thread source:: http://www.webmasterworld.com/robots_txt/3971082.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com