homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google AdSense
Forum Library, Charter, Moderators: incrediBILL & jatar k & martinibuster

Google AdSense Forum

Heeeeelp MediaBot has gone insane.

 5:27 pm on Jul 27, 2003 (gmt 0)

Mediabot is requesting a page 1000's of times a day and this page NEVER had any ads on it. The user who originally went to this page was using a "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/85 (KHTML, like Gecko) Safari/85"

Of the 30,000 messages in my mail section this is the only one being requested. What do i do?

2003-07-27 07:05:29 - myip 80 GET /message.asp message_id=29656&autologinid=901537711980040e14[Microsoft][ODBC_SQL_Server_Driver][SQL_Server]Line_1:_Incorrect_syntax_near_'='. 500 0 235 160 sitename Mediapartners-Google/2.1+(+http://www.googlebot.com/bot.html) -

This page would never have loaded for the original user in the first place as it generated a ASP 500 error.



 10:02 pm on Jul 27, 2003 (gmt 0)

Can you ban it by using robots.txt for the /message.asp? You can just ban the AdSense bot, and not the Googlebot, if that is a concern.

I know that the AdSense bot is requesting robots.txt nearly everytime it visits any of my sites, so it should solve the problem quickly.

Here is the information for the AdSense bot using robots.txt
Note that the information on the page is to ALLOW the AdSense bot on all pages, so you will need to change it accordingly, and you should probably run it through the robots.txt validator here before you unleash it ;)


 4:33 am on Jul 28, 2003 (gmt 0)

on error resume next did the trick...


 6:30 am on Jul 28, 2003 (gmt 0)

on error resume next did the trick...

I still haven't had my cup of coffee, so care to explain me whats that ;)

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google AdSense
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved