thrasher141 - 8:31 pm on Jun 26, 2006 (gmt 0)

hannamyluv,
You said "why havn't search engines provided the funds to ensure the websites and pages they are cataloging are allowed to be cataloged?" (I still don't know how to do that quote thing).

What do you mean by this? Currently the system is opt-out by way of robots.txt or other things like metatags and NOFOLLOW directives, etc. Are you saying you'd prefer an opt-in system, where SE's are not allowed to index a site unless it explicitly gives them permission?

Also, the difference between a newspaper printing sensitive info and Google indexing it is that a human reviews everything in a newspaper, so there is somebody to blame if something sensitive were printed. With an automated system like a SE, we don't have this check so isn't it understandable that something sensitive could get into the index? And isn't it reasonable enough to have safeguards like robots.txt and an emergency removal process (which apparently Google does)?