Forum Moderators: open
i uploaded a text file (with no extension) to my webserver last night, for about 5 minutes, to share it with a friend. it wasn't linked anywhere, just uploaded, read by this friend and removed from the ftp. this morning i saw in the logs that google's bot had spidered this file. how could it possibly have found it? (if it makes any difference the apache server does directory indexing but there was a default document in this folder)
i randomly upload things that shouldn't be on the server just for temporary space, but im not to keen on it now that google seems to spider it instantly.
best regards,
daniel
Many people believe that, when you visit a new page with the Google Toolbar, it will lead to the page being spidered.
For this, and other, reasons a web site is not really a safe place for genuinely "secret" information. Anything confidential loaded on a web site should probably be password protected.
(im sorry if this is the wrong forum, i honestly couldn't find any better)
Probably the Google News Forum would be the appropriate place since your question is about Googlebot. Do not worry, the moderators move threads that are started in the "wrong" forum.
