Recently My page is heavily crawled by
Mediapartners-Google/2.1. I don't have any adsence ad but still it is giving visit regulerly and wasting my bandwidth .How can I disallow this bot? What is it's exclusion name for robots.txt file? I use googlebot for Google.
Moreover I have seen in my raw log file that it doesn't call for robots.txt file .I m using a content management system called php-nuke. I have moded it using mod_rewrite. But I don't want to use noindex or noarchive for all bots. I just don't want
Mediapartners-Google/2.1to crawl my pages.
How can I do it?
Thanks in advance.
