Forum Moderators: martinibuster

Message Too Old, No Replies

Mediabot blocked

Suddenly, no changes made

         

adfree

8:18 am on Dec 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I got full control over my server. Haven't changed the robot.txt in three months. After discovering some bad targeting, G informs me now that they are having trouble to crawl. Only: I can't detect anything bad, I do not specifically mention mediabot in the robots file but I allow the main parts in general for all bots.

What might be wrong that mediabot is havng trouble for just the past week as reported by G? Anyone with similar trouble?

ncw164x

8:36 am on Dec 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



check your robots.txt file using the link below
[searchengineworld.com...]

adfree

10:01 am on Dec 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No errors detected! This Robots.txt validates to the robots exclusion standard!

ncw164x

10:22 am on Dec 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



From the adsense login google recommend you add this to your robots.txt file

User-agent: Mediapartners-Google*
Disallow:

or you could just have a blank robots.txt file, I have tried both ways without a problem

Have you checked the server header to see if there is a possible problem there?
Have you changed any of the pages lately which could be causing a problem?

Check your server error log file and also the site log file for the http codes when mediabot has visited.

adfree

12:45 am on Dec 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Can't really find anything.
Can anyone help me please?
I'll pay with Paypal immediately when fixed.
Only server champs, maybe there is more to fix.
Thanks!

ncw164x

1:21 am on Dec 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Is it the site in your profile which you are having trouble with?

adfree

7:52 am on Dec 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



nope, will sticky you

adfree

11:54 am on Dec 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google resolved it! They sent me an e-mail telling me it's resolved from their end. Now, targeting is DRAMATICALLY better for the entire site, the page in question is fixed and shows nice, targeted ads and even the sub domain is MUCH better in targeting.

If there wasn't the ongoing Google update today I would be so much happier...