Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- deny a spider from visiting a single page


jdMorgan - 10:15 pm on Dec 24, 2003 (gmt 0)


Michael,

Well, that would be:

User-agent: Googlebot
Disallow: /index2.html

The other alternative is cloaking. Personally, I wouldn't recommend either approach, unless it's a throw-away domain. I'd simply find a way to integrate a second, different, and useful page that would rank well where the other one does not. Others may disagree.

The main problem I see with this two-page robots approach is that you will be splitting your incoming links across two pages. Although the engines other than Google don't use the PageRank concept per-se, some of them do take into account "link popularity" and clustering. So, you'll take a hit from that angle as well. :(

Jim


Thread source:: http://www.webmasterworld.com/robots_txt/221.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com