When i would like to exclude subdomains cgi-bin folder, how can i do this? Should there be a different robots.txt in the subdomains root or should i use the main domains robots.txt, to exclude it?
closed
6:38 am on Jan 23, 2004 (gmt 0)
You got it the first time ;-): put a separate robots.txt in the subdomain's root.
