homepage Welcome to WebmasterWorld Guest from 50.19.172.0
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
How to stop search engines caching my webpages?
gcan

5+ Year Member



 
Msg#: 4000834 posted 12:12 pm on Oct 4, 2009 (gmt 0)

Hello,

Is there some way how to stop search engines saving my webpages on their servers?

Many people are not happy that their profiles of social network websites are being cached by Google or other search engines. There are many situations when people immediately want to delete their profiles from one or another website. Unfortunately, it's not possible for 100% because deleted profiles are still available at Google, Yahoo etc.

Of course, I want my webpages to be indexed by all search engines. The question is just about saving my files to their servers.

Thank you.

 

benevolent001

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4000834 posted 12:20 pm on Oct 4, 2009 (gmt 0)

Hi

Add the following to your head section

<META NAME="ROBOTS" CONTENT="NOARCHIVE">

This will stop Google and SE from doing that.

gcan

5+ Year Member



 
Msg#: 4000834 posted 12:44 pm on Oct 4, 2009 (gmt 0)

hi, thank you for your reply.

OK, I can do so, but I hope it will not affect my search engines rating...?

Leosghost

WebmasterWorld Senior Member leosghost us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 4000834 posted 1:24 pm on Oct 4, 2009 (gmt 0)

It won't

gcan

5+ Year Member



 
Msg#: 4000834 posted 3:02 pm on Oct 4, 2009 (gmt 0)

Ok, thank you.

StoutFiles

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4000834 posted 5:12 pm on Oct 4, 2009 (gmt 0)

Many people are not happy that their profiles of social network websites are being cached by Google or other search engines. There are many situations when people immediately want to delete their profiles from one or another website. Unfortunately, it's not possible for 100% because deleted profiles are still available at Google, Yahoo etc.

Those people should read the fine print then. They forfeit the rights to that information when they give it to a social networking site.

benevolent001

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4000834 posted 6:03 pm on Oct 4, 2009 (gmt 0)

Many website have options to stop giving person information outside website. But we need to read those instructions carefully , which we are used to skip and hurriedly click YES I ACCEPT as in EULA agreements.

gcan

5+ Year Member



 
Msg#: 4000834 posted 12:50 pm on Oct 10, 2009 (gmt 0)

benevolent001, it's not a problem that Google or any other search engines index user profiles. My post is about caching pages. It's not really normal that profiles which have been deleted from the website are still available at Google.

And it's not only about profiles. If some bad guy posts something illegal in my forum, classifieds section, blog etc, and I delete this post after Google's visit, this post will be available as cached webpage at Google.com for months (maybe for years).

bigcat1967

5+ Year Member



 
Msg#: 4000834 posted 1:48 am on Oct 20, 2009 (gmt 0)

there's another bot that archives data - can't remember what it is called...time(something) - anyone know what I'm talking about (brain fart)

Jonesy

5+ Year Member



 
Msg#: 4000834 posted 8:54 pm on Oct 21, 2009 (gmt 0)

The Way Back Machine?

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 4000834 posted 4:31 am on Nov 2, 2009 (gmt 0)

If the Wayback Machine at archive.org is the one you mean, the bot answers to this:

User-agent: ia_archiver

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved