Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt command to disallow indexing

I want to only disallows robots to index a specific directory

4:39 am on Jan 18, 2003 (gmt 0)

New User

10+ Year Member

joined:Jan 17, 2003
votes: 0

I just want to verify that this command: " user-agent: * Disallow: /a/ " will only ban robots from indexing the "a" directory but still allow robots to index the rest of my site.

I have cloaked my affiliated merchant's URLs to protect my interest. I know that cloaking is against google's policy. But how about cloaking URLs, is that also against google's policy?

All my cloaked files are in my "a" directory. That is why I want to ban robots from indexing that directory. Will this satisfy google?

Your feedback would be GREATLY appreciated.

4:50 am on Jan 18, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
votes: 0


Almost - Watch your capitalization.

http://www.webmasterworld.com/forum24/403.htm [webmasterworld.com]