Welcome to WebmasterWorld Guest from

Forum Moderators: buckworks & eWhisper & skibum

Message Too Old, No Replies

Blocking Robots

Can it be done for different landing pages?

4:44 am on Jan 27, 2009 (gmt 0)

Preferred Member

10+ Year Member

joined:July 8, 2004
votes: 0

If I want to have various landing pages for different sets of keywords eg. Red Widgets page title for red widgets keyword campaign is it ok to block robots from indexing them? Will they still get decent adwords quality score?

Otherwise all the variation pages with just headings changed would become duplicate content and lose any natural traffic to the original page.

Anyone have any thoughts or experience on this?

6:16 pm on Jan 28, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 2, 2006
votes: 6

You can exclude individual files/pages through robots.txt. Google AdWords bot will still have an access to them as it ignores the default * setting on disallow.


Google AdWords bot's name is: Adsbot-Google


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members