Welcome to WebmasterWorld Guest from

Forum Moderators: rogerd

Message Too Old, No Replies

password protected pages

how google can read password protected pages

6:21 am on Jul 15, 2009 (gmt 0)

New User

5+ Year Member

joined:Apr 24, 2009
posts: 8
votes: 0

I am in the process of changing the look of the site. I have created a new folder on the existing site directory and saved the new site in there. This folder was made password protected but no wonder Google can still Index is. I just wonder how crawlers can crawl through those pages?
4:02 am on July 17, 2009 (gmt 0)

Administrator from JP 

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 12, 2000
votes: 49

If the folder is password protected then they can't get in and crawl on their own. Have you provided them with the same information before? Was there a time the material was online before being password protected?
5:31 am on July 17, 2009 (gmt 0)

Preferred Member

5+ Year Member

joined:Mar 29, 2007
votes: 0

Disallow this folder in the Robots.txt to avoid any further indexing.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members