Welcome to WebmasterWorld Guest from 54.226.194.180

Forum Moderators: incrediBILL & martinibuster

Message Too Old, No Replies

Heeeeelp MediaBot has gone insane.

     

markus007

5:27 pm on Jul 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Mediabot is requesting a page 1000's of times a day and this page NEVER had any ads on it. The user who originally went to this page was using a "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/85 (KHTML, like Gecko) Safari/85"

Of the 30,000 messages in my mail section this is the only one being requested. What do i do?

2003-07-27 07:05:29 64.68.87.66 - myip 80 GET /message.asp message_id=29656&autologinid=901537711980040e14[Microsoft][ODBC_SQL_Server_Driver][SQL_Server]Line_1:_Incorrect_syntax_near_'='. 500 0 235 160 sitename Mediapartners-Google/2.1+(+http://www.googlebot.com/bot.html) -

This page would never have loaded for the original user in the first place as it generated a ASP 500 error.

Jenstar

10:02 pm on Jul 27, 2003 (gmt 0)

WebmasterWorld Senior Member jenstar is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Can you ban it by using robots.txt for the /message.asp? You can just ban the AdSense bot, and not the Googlebot, if that is a concern.

I know that the AdSense bot is requesting robots.txt nearly everytime it visits any of my sites, so it should solve the problem quickly.

Here is the information for the AdSense bot using robots.txt
[google.com...]
Note that the information on the page is to ALLOW the AdSense bot on all pages, so you will need to change it accordingly, and you should probably run it through the robots.txt validator here before you unleash it ;)

markus007

4:33 am on Jul 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



on error resume next did the trick...

Imaster

6:30 am on Jul 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



on error resume next did the trick...

I still haven't had my cup of coffee, so care to explain me whats that ;)

 

Featured Threads

Hot Threads This Week

Hot Threads This Month