homepage Welcome to WebmasterWorld Guest from 54.166.159.110
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
Load Balancer IP Address is Crawled
anne10



 
Msg#: 4224806 posted 11:55 am on Nov 1, 2010 (gmt 0)

Hi,

we are using load balancer concept. I pointed my domain to my load balancer ip address. My site is working now. but my problem is load balancer ip address also crawled by google.Please help me how to solve this issue?

 

g1smd

WebmasterWorld Senior Member g1smd us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 4224806 posted 10:24 pm on Nov 1, 2010 (gmt 0)

You could set up a rule that tests the HTTP_HOST variable with a RewriteCond, and rewrites requests for /robots.txt to a different file that disallows everything if the requested hostname is the loadbalancer's IP address.

jdMorgan

WebmasterWorld Senior Member jdmorgan us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 4224806 posted 5:05 pm on Nov 29, 2010 (gmt 0)

The problem may begin here:

I pointed my domain to my load balancer ip address


The term "point" is non-technical 'slang' and is ambiguous. So specifically *how* did you *point* your address? If you did anything but define an "A" or "CNAME" record in your DNS zone file specifying the load-balancer's IP address, then that may be the problem.

Jim

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved