Welcome to WebmasterWorld Guest from

Forum Moderators: mademetop

Message Too Old, No Replies

Hiding ad pages from bots

7:38 pm on Sep 24, 2008 (gmt 0)

New User

5+ Year Member

joined:Sept 24, 2007
posts: 35
votes: 0

I have developed a web application which will conditionally show ads if the url is suffixed by a "/1". For example:


If a visitor enters the site this way, a session variable is set that will cause all pages to show these ads, even if there is no "/1" appended.

At the same time that the ads are shown, I have added this:

<meta name="robots" content="noindex, nofollow">

The goal is to not have search engines index pages with ads, so that those pages will not have a canonical problem with duplicate content.

So, my question is, is this a fool-proof way to make sure that Google, and other search engines, can never index pages that show ads, and that we will not risk duplicate content penalties?

4:47 am on Sept 26, 2008 (gmt 0)

New User

5+ Year Member

joined:July 8, 2008
votes: 0

Using javascript for the ads may help sometimes. Look how google adsense works. Doesnt get indexed as content. FYI i have seen yahoo index google ads! and sometimes google indexes yahoo ads. But that will also depend on how they are being displayed. Some webmasters have found a way to make the JS ads appear as HTML and get indexed but thats a different topic.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members