homepage Welcome to WebmasterWorld Guest from 54.167.185.110
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
Apache Cloaking to switch spider from production server
Any comments on Apache configurations with mod_rewrite please.
killroy




msg:1505744
 7:57 pm on Sep 6, 2003 (gmt 0)

Hi, I've just noticed my production domain popped into google. What is the best way to avoid this, and is cloakign in this instance accurate?

I'm currently experimenting with this config:

RewriteCond %{HTTP_USER_AGENT} Googlebot/2.1
RewriteRule ^/?(.*) [domain.com...] [R=301,L]

RewriteRule ^/(index\.htag/)?([^.]+)$ /index.htag/$2 [L]

This is on my production server domain. So for me going to www.productiondomain.com should work as usual, applying the last RewriteRule above. But when googlebot arrives, it should send him straight to the live server and avoid in-index doplication.

Somehow it's cloaking but not really, as th econtent is mostly the same.

Also it leaves me free to send people to the production server and show them new material.

Also it should leave other spiders alone, such as th eadSense bot and my site search engine bot.

Does this look ok? I checked the headers with the header checker and it seems ok, but without beeing bgooglebot its hard to be sure.

Thanks,

SN

 

killroy




msg:1505745
 8:59 pm on Sep 6, 2003 (gmt 0)

Hmm somebody must be interested in mod_rewrite... please?

SN

closed




msg:1505746
 11:06 pm on Sep 6, 2003 (gmt 0)

Have you tried using Wannabrowser? You can change the User Agent there.

killroy




msg:1505747
 12:32 pm on Sep 7, 2003 (gmt 0)

Thanks guys, it seems to work fine liek this.

SN

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved