homepage Welcome to WebmasterWorld Guest from 23.22.76.170
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Pubcon Website
Visit PubCon.com
Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
Forum Library : Charter : Moderators: rogerd

Community Building and User Generated Content Forum

    
password protected pages
how google can read password protected pages
engine friend




msg:3952763
 6:21 am on Jul 15, 2009 (gmt 0)

I am in the process of changing the look of the site. I have created a new folder on the existing site directory and saved the new site in there. This folder was made password protected but no wonder Google can still Index is. I just wonder how crawlers can crawl through those pages?

 

bill




msg:3954153
 4:02 am on Jul 17, 2009 (gmt 0)

If the folder is password protected then they can't get in and crawl on their own. Have you provided them with the same information before? Was there a time the material was online before being password protected?

AnkitMaheshwari




msg:3954188
 5:31 am on Jul 17, 2009 (gmt 0)

Disallow this folder in the Robots.txt to avoid any further indexing.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved