Hello, I was wondering, I have my administration area 'protected' through some php coding, but wil Robots be able to index them, although any normal user cannot read them unless they are logged in?
Or if so, when protecting through htaccess, how is this then?
(I do not like to add my administration area it the robots.txt, because everone can read the file, and find the link).
Dijkgraaf
7:48 pm on Nov 3, 2005 (gmt 0)
If the pages are password protected then bots would probably not be able to get it either, if they were able then there is something wrong with your password protecting, but just to make sure that bots don't even try what you could do is put a partial match to your protected area in robots.txt e.g. if your protected area is called /admin and you have nothing else starting with adm that you want indexed then put disallow: /adm in your robots.txt file
