Forum Moderators: phranque

Message Too Old, No Replies

Indexing Password Protected Content

how can i get subscrpition content index - apache trick?

         

koseo

4:56 pm on Jun 8, 2006 (gmt 0)

10+ Year Member



Hi, I have a subscrption site with 5,000+ pages which i'd like google to index but at the same time prevent unregistered users of the website from seeing any of the subscription content.

I can see WebmasterWorld are doing this using some type of cookie based authentication but does anyone know if they are doing anything special with apache?

Thanks in advance

Matt, UK

jdMorgan

9:47 pm on Jun 8, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The answer depends on how you currently do authentication/authorization.

If you are using Apache mod_auth with mod_access, then see the "Satisfy" directive in Apache core. You can set "Satisfy any" and then "Allow from" search engine IP addresses or hostnames, or alternately set an envar using mod_setenvif based on the user-agent name (e.g. Googlebot), and "Allow from" that envar.

If you're using a script for doing auth, then you'll need to add the IP/hostname/useragent sensing to that script.

Jim