Welcome to WebmasterWorld Guest from 54.225.28.32

Forum Moderators: buckworks & eWhisper & skibum

Message Too Old, No Replies

Blocking Robots

Can it be done for different landing pages?

     
4:44 am on Jan 27, 2009 (gmt 0)

Preferred Member

10+ Year Member

joined:July 8, 2004
posts:546
votes: 0


If I want to have various landing pages for different sets of keywords eg. Red Widgets page title for red widgets keyword campaign is it ok to block robots from indexing them? Will they still get decent adwords quality score?

Otherwise all the variation pages with just headings changed would become duplicate content and lose any natural traffic to the original page.

Anyone have any thoughts or experience on this?

6:16 pm on Jan 28, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 2, 2006
posts:2183
votes: 5


You can exclude individual files/pages through robots.txt. Google AdWords bot will still have an access to them as it ignores the default * setting on disallow.

[google.com...]

Google AdWords bot's name is: Adsbot-Google