Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Googlebot Indexing Anything it Finds


g1smd - 6:41 pm on Jul 17, 2006 (gmt 0)


>> So it's there for all the freak stalkers to look at that download the robots.txt .... and go then exactly to these pages... <<

Not if you disallow a folder, then make sure the folder does not serve a directory index, and put files with un-guessable names in there, or maybe even put the files one folder deeper in an un-guessable sub-folder name.


Thread source:: http://www.webmasterworld.com/google/35088.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com