we are using load balancer concept. I pointed my domain to my load balancer ip address. My site is working now. but my problem is load balancer ip address also crawled by google.Please help me how to solve this issue?
g1smd
10:24 pm on Nov 1, 2010 (gmt 0)
You could set up a rule that tests the HTTP_HOST variable with a RewriteCond, and rewrites requests for /robots.txt to a different file that disallows everything if the requested hostname is the loadbalancer's IP address.
jdMorgan
5:05 pm on Nov 29, 2010 (gmt 0)
The problem may begin here:
I pointed my domain to my load balancer ip address
The term "point" is non-technical 'slang' and is ambiguous. So specifically *how* did you *point* your address? If you did anything but define an "A" or "CNAME" record in your DNS zone file specifying the load-balancer's IP address, then that may be the problem.
