Welcome to WebmasterWorld Guest from

Forum Moderators: rogerd

Message Too Old, No Replies

password protected pages

how google can read password protected pages


engine friend

6:21 am on Jul 15, 2009 (gmt 0)

5+ Year Member

I am in the process of changing the look of the site. I have created a new folder on the existing site directory and saved the new site in there. This folder was made password protected but no wonder Google can still Index is. I just wonder how crawlers can crawl through those pages?


4:02 am on Jul 17, 2009 (gmt 0)

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

If the folder is password protected then they can't get in and crawl on their own. Have you provided them with the same information before? Was there a time the material was online before being password protected?


5:31 am on Jul 17, 2009 (gmt 0)

5+ Year Member

Disallow this folder in the Robots.txt to avoid any further indexing.

Featured Threads

Hot Threads This Week

Hot Threads This Month