I have a .net app which serves 4 sites and am now in need of 4 different robots.txt files for each site. I'm currently using isapi_rewrite and tried to set up a rule for this, but it failed. Here's what I wrote: RewriteCond Host: ^mysite\.com
ReWriteRule robots\.txt robots_td.txt [I,O,L,RP]
When I try this I still get the original robots.txt displaying in the browser.
Does anyone have any clues why this isn't working?
Are there any other possible workarounds?
thanks