Welcome to WebmasterWorld Guest from 18.104.22.168
My question is when the server is set up and the DR is complete we will have 2 identical sites set up on 2 different servers. Ideal DR but from experience I know Google, yahoo, or MSN can find then spider this DR server even wih no links.
The browser sends the bot to visit if enabled so what suggestions would be the best way to block all activity.
Windows server so is robots text the only and best way as there are just to many IP's from the SE's to try it by IP and they are always adding new ones.
Any suggestions would be greatly appreciated.
This will as well give our CEO the ability to show investors how their investments are backed up through a live demonstration.