Welcome to WebmasterWorld Guest from 23.20.241.155

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt command to disallow indexing

I want to only disallows robots to index a specific directory

     
4:39 am on Jan 18, 2003 (gmt 0)

10+ Year Member



I just want to verify that this command: " user-agent: * Disallow: /a/ " will only ban robots from indexing the "a" directory but still allow robots to index the rest of my site.

I have cloaked my affiliated merchant's URLs to protect my interest. I know that cloaking is against google's policy. But how about cloaking URLs, is that also against google's policy?

All my cloaked files are in my "a" directory. That is why I want to ban robots from indexing that directory. Will this satisfy google?

Your feedback would be GREATLY appreciated.

4:50 am on Jan 18, 2003 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Wellnesscafe,

Almost - Watch your capitalization.

http://www.webmasterworld.com/forum24/403.htm [webmasterworld.com]

Jim

 

Featured Threads

Hot Threads This Week

Hot Threads This Month