I get some decent SE traffic leading directly to my widget pages. Each of the widgets is available in about 10 different styles, but mainly it's the same stuff. In order to avoid dup content or water down the pages I placed 10 links each leading to sub-pages that contain the exact product description and a white label shop where people can order from my aff partner.
All those sub-pages are off-limits for gbot (noindex, nofollow) + robots.txt .
Now I'd like to get some more traffic - this time buying it from G. If I use the same landing pages for Adwords ads that I use for organic traffic, I can't tell which is which.
In order to be able to see which part of the traffic comes from Adwords,
I could
1. create a new site that only handles the adwords traffic
2. send the adwords traffic to the subpages that are off-limits for gbot
3. send the adwords traffic to the normal landing pages, but use another url so I can tell the difference.
4. find out how to tell the difference without changing anything ;-)
What would you suggest?
Can I use an URL in Adwords that is forbidden for gbot?
Does Adwords quality checking use gbot or an independent bot that could be allowed in separately?
Thanks a lot,
nerd.
AdsBot-Google [adwords.google.com] ignore any robots.txt directive that is not specific to it. So, if you have an entry similar to...
User-agent: *
Disallow: /thisdirectory
...AdsBot-Google will ignore that if it has to spider a landing page located in that directory.
If I use the same landing pages for Adwords ads that I use for organic traffic, I can't tell which is which.
And a general point...
All those sub-pages are off-limits for gbot (noindex, nofollow) + robots.txt .
thanks for the insight.
It's probably best not to use the same pages anyway as optimizing for AdWords quality score purposes can be at odds wit optimizing for organic results.
could you pls. give me a starting point - are there any hard facts about the likes and dislikes of the adwords bot - in comparison to organic stuff?
