homepage Welcome to WebmasterWorld Guest from 54.161.166.171
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
Forum Library, Charter, Moderators: rogerd

Community Building and User Generated Content Forum

    
password protected pages
how google can read password protected pages
engine friend




msg:3952763
 6:21 am on Jul 15, 2009 (gmt 0)

I am in the process of changing the look of the site. I have created a new folder on the existing site directory and saved the new site in there. This folder was made password protected but no wonder Google can still Index is. I just wonder how crawlers can crawl through those pages?

 

bill




msg:3954153
 4:02 am on Jul 17, 2009 (gmt 0)

If the folder is password protected then they can't get in and crawl on their own. Have you provided them with the same information before? Was there a time the material was online before being password protected?

AnkitMaheshwari




msg:3954188
 5:31 am on Jul 17, 2009 (gmt 0)

Disallow this folder in the Robots.txt to avoid any further indexing.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved