Forum Moderators: mack

Message Too Old, No Replies

MSN adds my history to its crawl!

found my private proxy in search results ..

         

mifi601

2:33 pm on Apr 28, 2005 (gmt 0)

10+ Year Member



Big surprise to find my directories, that are completely private, not linked from anywhere, such as proxies in MSN search results!

Anyone else a similar experience?

Went and changed all my robots.txt, but is MSN going to update their records with the next crawl?

mack

12:59 am on Apr 29, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I think we just ahve to accept that there is no such thing as a private web folder any longer. All it takes is for you to click an external link from within your private area and you may have a public link on someones web stats pages.

The only way to have something truely private is to have it on a test server that does not accept incoming traffic. Or if you need to have it on a public site, password protect your test/private area.

Mack.

mifi601

1:45 pm on Apr 29, 2005 (gmt 0)

10+ Year Member



You are right. And I should have known. It was still a surprise and I have password protected that folder as well ...