We are finally setting up a DR correctly and I am really glad as we had a huge huge problem that was fixed with a shoe string. I have been hammering on this for years and finally got them to look at our so called DR plan we have now. The owner got white when he found out the time we would be down with this currect plan.
My question is when the server is set up and the DR is complete we will have 2 identical sites set up on 2 different servers. Ideal DR but from experience I know Google, yahoo, or MSN can find then spider this DR server even wih no links.
The browser sends the bot to visit if enabled so what suggestions would be the best way to block all activity.
Windows server so is robots text the only and best way as there are just to many IP's from the SE's to try it by IP and they are always adding new ones.
I think I have got an answer for my own question. we are going to point the dns to a folder with just an htm page to dr.example.com so if we ever need the real deal change the DNS and point it at the correct folder for the domain. This should keep any unwanted spiders out of the server and the site can be checked from time to time by actually setting the dns to point to the correct folder but not changing the IP address of the live domain.
This will as well give our CEO the ability to show investors how their investments are backed up through a live demonstration.