| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
|Accredited PayPal World Seller|
|How would I disallow Google...|
...and allow all others?
| 11:44 pm on Nov 27, 2004 (gmt 0)|
I have some duplicate content that I don't want Google (to keep) penalizing me for, and I was wondering how to accomplish the following with a robots.txt:
1) Disallow Google totally.
2) Allow Googlebot into index page (and links pages), but disallow to other sub-pages.
| 11:53 pm on Nov 27, 2004 (gmt 0)|
for the second u may use meta tags
| 5:35 pm on Nov 28, 2004 (gmt 0)|
Is there a way to disallow subpages with a robots.txt? Changing individual pagess can be a bit tedious.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved