Blocking SEO bot but letting the AdWords bot pass

[adpilot]

Hi!

Letīs say I run a site via example.com and I advertise on example.com/landingpages/page1/ - how can I block all organic bots from indexing /landingpages/* but ensure that Googles AdWords bot passes so the landingpages get recognized?

Thanks!

[edited by: buckworks at 8:32 pm (utc) on Jan. 8, 2010]
[edit reason] Please use "example.com" - it will never be owned [/edit]

[bwnbwn]

To prevent Adsbot-google from accessing your site, add the following to your robots.txt file:
User-agent: Adsbot-google
Disallow: /

So, using this, is it possible that we allow only this bot to crawl the site and no other bot including googlebot natural search bot?

[webmasterworld.com...] Pulled from here..

[smallcompany]

User-agent: *
Disallow: /

The above should do it for those that obey robots.txt

AdBot ignores robots.txt entries unless they have been specified for it.

In other words, as long as you don;t mention AdBot, you're fine and sure that it can access your site.

Furthermore, in WMT (Webmaster Tools) you can test your robots.txt file against Google's bots. The tool will tell you what's allowed and what is not.

[adpilot]

Perfect, thanks both of you!