Welcome to WebmasterWorld Guest from

Forum Moderators: phranque

Message Too Old, No Replies

Allow Spiders to Enter Protected Area .

Allowing SE to Indexing membership content but not deliverying ...


Dabu The Dragon

7:52 pm on Dec 14, 2006 (gmt 0)

10+ Year Member

How do you feel about allowing spiders to index member content and this information appearing on SE. And once a human visitor clicks on the result then are taken to a permissioned user//pass page.

Is this a common thing? Is this spamming?

[edited by: Dabu_The_Dragon at 7:55 pm (utc) on Dec. 14, 2006]


2:08 am on Dec 15, 2006 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

this is common in any type of subscription web application - forums, news, etc...

Featured Threads

Hot Threads This Week

Hot Threads This Month