| Welcome to WebmasterWorld Guest from 22.214.171.124 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
| 2:39 pm on Jan 21, 2004 (gmt 0)|
When i would like to exclude subdomains cgi-bin folder, how can i do this? Should there be a different robots.txt in the subdomains root or should i use the main domains robots.txt, to exclude it?
| 6:38 am on Jan 23, 2004 (gmt 0)|
You got it the first time ;-): put a separate robots.txt in the subdomain's root.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved