| Welcome to WebmasterWorld Guest from 184.108.40.206 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|robots.txt command to disallow indexing|
I want to only disallows robots to index a specific directory
| 4:39 am on Jan 18, 2003 (gmt 0)|
I just want to verify that this command: " user-agent: * Disallow: /a/ " will only ban robots from indexing the "a" directory but still allow robots to index the rest of my site.
I have cloaked my affiliated merchant's URLs to protect my interest. I know that cloaking is against google's policy. But how about cloaking URLs, is that also against google's policy?
All my cloaked files are in my "a" directory. That is why I want to ban robots from indexing that directory. Will this satisfy google?
Your feedback would be GREATLY appreciated.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved