Forum Moderators: open

Message Too Old, No Replies

How not to have a web page Indexed?

         

palmpal

10:07 pm on May 1, 2003 (gmt 0)

10+ Year Member



Hello,

Is there a way to NOT have a web page crawled/indexed? I have a copyright notice page that is linked to from other pages. I've had a quite a few visitors enter my site on this page. It's probably not the best page for a "first impression" since it deals with my terms of use, etc. Can I put something in my robots.txt file so google doesn't index it?

Thanks!

pageoneresults

10:09 pm on May 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



User-agent: *
Disallow: /copyright.htm

Or whatever the appropriate file name is. Make sure to validate your robots.txt file [searchengineworld.com] each time a change is made just to make sure that everything is okay.

palmpal

10:21 pm on May 1, 2003 (gmt 0)

10+ Year Member



Thanks for the quick response!

pageoneresults

10:45 pm on May 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've had a quite a few visitors enter my site on this page.

The above statement is what would prevent me from blocking that page. If you've got a respectable number of visitors coming in through that page, its no big deal. As long as they have access to navigation that will lead them to the information they were searching for.