Forum Moderators: open

Message Too Old, No Replies

Google & .htaccess pages

.htaccess protected pages are visible in Google?

         

Panda

10:59 am on Nov 12, 2002 (gmt 0)



...excuse me for my English, but I'm italian.

Anyone knows if Google finds pages protected with .htaccess?

Thanks, Panda

rfgdxm1

11:09 am on Nov 12, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Obviously what you are doing isn't secure. The mere fact it is possible for Googlebot to find these means that *anyone* can.

NameNick

11:37 am on Nov 12, 2002 (gmt 0)

10+ Year Member



Panda,

Welcome to WebmasterWorld [webmasterworld.com].

It depends on whether you set a link to those pages. But even if Google found .htaccess protected pages, it doesn't matter. As long as the Google Bot don't know username and password, those pages won't get indexed. And that means as long as you don't set username and password in the link[1] to the protected page, nothing happens.

[1] i.e.: http: //username:password@your-server.com/protected/page.html

NN

ciml

11:48 am on Nov 12, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to WebmasterWorld Panda.

Google doesn't list URLs that return 403 or 404 unlesss they are /robots.txt excluded. If they are /robots.txt excluded then the URLs may be listed, but the content won't be indexed.

NameNick, would Googlebot send a username and password if you link to "username:password@your-server.com"? I don't think I've seen that mentioned before.

NameNick

1:59 pm on Nov 12, 2002 (gmt 0)

10+ Year Member



ciml,

Good question. Technically it should work and the spider should follow the link. But I don't know, whether the spiders even do so. Probably you are right and they don't follow such a links by a selfmade rule or so.

NN

ciml

2:31 pm on Nov 12, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Does anyone reading this have a username:password@your-server.com link? If so, does it get crawled?