homepage Welcome to WebmasterWorld Guest from 54.198.148.191
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
Forum Library, Charter, Moderators: rogerd

Community Building and User Generated Content Forum

    
password protected pages
how google can read password protected pages
engine friend




msg:3952763
 6:21 am on Jul 15, 2009 (gmt 0)

I am in the process of changing the look of the site. I have created a new folder on the existing site directory and saved the new site in there. This folder was made password protected but no wonder Google can still Index is. I just wonder how crawlers can crawl through those pages?

 

bill




msg:3954153
 4:02 am on Jul 17, 2009 (gmt 0)

If the folder is password protected then they can't get in and crawl on their own. Have you provided them with the same information before? Was there a time the material was online before being password protected?

AnkitMaheshwari




msg:3954188
 5:31 am on Jul 17, 2009 (gmt 0)

Disallow this folder in the Robots.txt to avoid any further indexing.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved