homepage Welcome to WebmasterWorld Guest from 54.161.197.188
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
How to stop search engines caching my webpages?
gcan




msg:4000836
 12:12 pm on Oct 4, 2009 (gmt 0)

Hello,

Is there some way how to stop search engines saving my webpages on their servers?

Many people are not happy that their profiles of social network websites are being cached by Google or other search engines. There are many situations when people immediately want to delete their profiles from one or another website. Unfortunately, it's not possible for 100% because deleted profiles are still available at Google, Yahoo etc.

Of course, I want my webpages to be indexed by all search engines. The question is just about saving my files to their servers.

Thank you.

 

benevolent001




msg:4000840
 12:20 pm on Oct 4, 2009 (gmt 0)

Hi

Add the following to your head section

<META NAME="ROBOTS" CONTENT="NOARCHIVE">

This will stop Google and SE from doing that.

gcan




msg:4000853
 12:44 pm on Oct 4, 2009 (gmt 0)

hi, thank you for your reply.

OK, I can do so, but I hope it will not affect my search engines rating...?

Leosghost




msg:4000862
 1:24 pm on Oct 4, 2009 (gmt 0)

It won't

gcan




msg:4000887
 3:02 pm on Oct 4, 2009 (gmt 0)

Ok, thank you.

StoutFiles




msg:4000909
 5:12 pm on Oct 4, 2009 (gmt 0)

Many people are not happy that their profiles of social network websites are being cached by Google or other search engines. There are many situations when people immediately want to delete their profiles from one or another website. Unfortunately, it's not possible for 100% because deleted profiles are still available at Google, Yahoo etc.

Those people should read the fine print then. They forfeit the rights to that information when they give it to a social networking site.

benevolent001




msg:4000941
 6:03 pm on Oct 4, 2009 (gmt 0)

Many website have options to stop giving person information outside website. But we need to read those instructions carefully , which we are used to skip and hurriedly click YES I ACCEPT as in EULA agreements.

gcan




msg:4004749
 12:50 pm on Oct 10, 2009 (gmt 0)

benevolent001, it's not a problem that Google or any other search engines index user profiles. My post is about caching pages. It's not really normal that profiles which have been deleted from the website are still available at Google.

And it's not only about profiles. If some bad guy posts something illegal in my forum, classifieds section, blog etc, and I delete this post after Google's visit, this post will be available as cached webpage at Google.com for months (maybe for years).

bigcat1967




msg:4009786
 1:48 am on Oct 20, 2009 (gmt 0)

there's another bot that archives data - can't remember what it is called...time(something) - anyone know what I'm talking about (brain fart)

Jonesy




msg:4011067
 8:54 pm on Oct 21, 2009 (gmt 0)

The Way Back Machine?

tedster




msg:4017341
 4:31 am on Nov 2, 2009 (gmt 0)

If the Wayback Machine at archive.org is the one you mean, the bot answers to this:

User-agent: ia_archiver

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved