homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Marketing and Biz Dev / General Search Engine Marketing Issues
Forum Library, Charter, Moderators: mademetop

General Search Engine Marketing Issues Forum

Hiding ad pages from bots

5+ Year Member

Msg#: 3751511 posted 7:38 pm on Sep 24, 2008 (gmt 0)

I have developed a web application which will conditionally show ads if the url is suffixed by a "/1". For example:


If a visitor enters the site this way, a session variable is set that will cause all pages to show these ads, even if there is no "/1" appended.

At the same time that the ads are shown, I have added this:

<meta name="robots" content="noindex, nofollow">

The goal is to not have search engines index pages with ads, so that those pages will not have a canonical problem with duplicate content.

So, my question is, is this a fool-proof way to make sure that Google, and other search engines, can never index pages that show ads, and that we will not risk duplicate content penalties?



5+ Year Member

Msg#: 3751511 posted 4:47 am on Sep 26, 2008 (gmt 0)

Using javascript for the ads may help sometimes. Look how google adsense works. Doesnt get indexed as content. FYI i have seen yahoo index google ads! and sometimes google indexes yahoo ads. But that will also depend on how they are being displayed. Some webmasters have found a way to make the JS ads appear as HTML and get indexed but thats a different topic.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Marketing and Biz Dev / General Search Engine Marketing Issues
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved