homepage Welcome to WebmasterWorld Guest from 54.196.197.153
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Use FP 2000 and Want to Keep Goo from Indexing It
How?
ember




msg:3338683
 4:51 pm on May 13, 2007 (gmt 0)

We use FP 2000 (I know) and have a new site that we do not want to end up in the free listings of any search engine. Is there a code I can insert without messing up the pages that will keep Google's (and others) spider away? Do I need to insert the code, if there is one, in just the homepage or all pages?

We also plan to upgrade to Expression Web, soon. Will that make a difference?

 

dcheney




msg:3338685
 4:56 pm on May 13, 2007 (gmt 0)

search for "robots.txt" - that should do the trick

Marshall




msg:3338755
 7:54 pm on May 13, 2007 (gmt 0)

ember,

Between the <HEAD> and </HEAD> tags, and below the last meta tags already there, in the code/HTML view, insert:
<meta name="robots" content="noindex,nofollow">
<meta name="robots" content="noarchive">
<meta name="googlebot" contennt="noarchive">

In FP, you can click on the TOOLS tab and select PAGE OPTIONS. From there, select CODE SNIPPETS. Do NOT highlight any of the existing codes. Click on ADD and in the largest of the three windows, add the above code one at a time: insert one, click OK, insert the second one, click OK, etc. By doing this, FP will insert these codes automatically into every page. Otherwise, just do it manually.

ember




msg:3338944
 4:32 am on May 14, 2007 (gmt 0)

Thank you! I appreciate the help.

g1smd




msg:3343484
 9:25 pm on May 18, 2007 (gmt 0)

This should be enough; just one tag:

<meta name="robots" content="noindex, noarchive">

There is some confusion as to what may happen if there are multiple robots tags within one document.

Israel




msg:3354415
 11:02 am on May 31, 2007 (gmt 0)

We use FP 2000 (I know)

Ember,

You're not alone and no reason to feel sheepish or explain why you use FP 2000. I've used FP 2000 forever. Yeah, it creates bloated pages, but I go in afterward and clean up the bloat a bit and the HTML errors it creates (especially if you move things around with copy/paste).

I assume you use their "Publish" feature to upload your sites. Myself I found that a disaster and some hosts don't deal well with it.

However, if you have FTP access to your server or are willing to learn, you can upload the simple Notepad .txt file robots.txt to your root directory:

User-agent: *
Disallow: /

That wil keep all but the truly "rouge 'bots" away.

I don't know your skill level, but your web hosting provider is likely to take care of that for you if need be.

------
BTW, I'm not up to any 'tricks' or 'black hat' stuff or porn. These small sites contributers simply don't want their intimate posts blasted through the search engines.

Seems to work fine.

-----
I struggle with Dreamweaver but there are simply too many controls on the interface for this old man to even read them at the needed screen resolution...

HTH, otherwise experts! Tell me where I'm going wrong!

Israel

Marshall




msg:3354495
 12:19 pm on May 31, 2007 (gmt 0)

You should upgrade to FP2003. Okay, I am a pro-FP person. That being said, 2003 has a lot of features which make life REALLY easy, especially single page publishing vs. publishing the entire site, an HTML checker which removes bloated HTML and an access validator. Just my 2 cents worth.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved