Forum Moderators: open

Message Too Old, No Replies

No Follow tag

Explanation of Robot Meta Tag

         

tictoc

4:03 am on Feb 10, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



When you use the
META NAME="GOOGLEBOT" CONTENT="NOINDEX,NOFOLLOW
or the
META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW

is this command telling the Googlebot to leave the site and not go back to the page it came from on the site OR does it tell it to goto another page on the site and avoid this page?

Just wanted to make sure it goes back to the rest of the site if it sees this on one page.

Reid

7:22 am on Feb 10, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If it see's this made specifically for googlebot it will assume you are hiding something from google and there is no telling what action it will take next.
If you were going to do this at all you would be better off with
"robots" nofollow

which 'should' cause the robots to still index the rest of the site.

lammert

11:06 am on Feb 10, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



"noindex,nofollow" tells the spider to not include the file in the search index, and also not follow links in that page to search for other pages. Search engines still index all other pages of a site if they do not contain this meta tag. Most search engines use the noindex parameter, but many bots follow links regardless of the existence of the nofollow parameter.

Using this parameter does not hide the information for the bot, it tells what to do with the page. It can be very useful if you have individual pages that should not be included in search engines. Excluding groups of files is easier with a robots.txt file in your root directory.

More info at [google.com...]

tictoc

11:50 am on Feb 10, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



So it is not following links on the page it is on but will it go back to the page before and keep going through the rest of the site? I just wonder if it then quits the site altogether or not?

lammert

12:03 pm on Feb 10, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The spider ignores the current page, but indexes all others. Only the page with the "noindex,nofollow" tag is not spidered. I have used this tag on many pages that I didn't want to show up in search engines (login pages, error pages etc) and I have never had any problems with other pages on the same site: they all showed up in the index.

The spider does not quit the site altogether, unless you use the "noindex,nofollow" on your main index.html and there are no other links to your internal pages. In that case the spider 'might not know those pages exist.