Welcome to WebmasterWorld Guest from 188.8.131.52 , register , login , search , subscribe , help , library , PubCon , announcements , recent posts , open posts Subscribe to WebmasterWorld
rewriting robots.txt piconsulting msg:3209878 10:17 pm on Jan 5, 2007 (gmt 0) I have a .net app which serves 4 sites and am now in need of 4 different robots.txt files for each site. I'm currently using isapi_rewrite and tried to set up a rule for this, but it failed. Here's what I wrote:
RewriteCond Host: ^mysite\.com
ReWriteRule robots\.txt robots_td.txt [I,O,L,RP]
When I try this I still get the original robots.txt displaying in the browser.
Does anyone have any clues why this isn't working?
Are there any other possible workarounds?
piconsulting msg:3212255 5:26 pm on Jan 8, 2007 (gmt 0)
Well it looks like I had some syntax issues in the rule, here's the correct version in case anyone else is interested:
RewriteCond Host: myfirstsite\.com
RewriteRule /robots\.txt /robots_1st.txt [I,O] RewriteCond Host: mysecondsite\.com RewriteRule /robots\.txt /robots_2nd.txt [I,O]