Forum Moderators: martinibuster

Message Too Old, No Replies

Google IP Sucking My Bandwidth

Google DDOS?

         

CheeseburgerBrown

11:59 am on Mar 23, 2005 (gmt 0)

10+ Year Member



Okay, DDOS is a massive exaggeration, but Google has sucked over 100 MB of my bandwidth repeatedly downloading the same 24 kb file over the last three days. (I say Google because it comes from a Google IP, and the referrer is one of their advertising servers.)

This started when I put AdLinks on the page, and hasn't stopped since. The file in question is generating a 1200% increase in raw hits, but no more than normal impressions as reported by AdSense and no change in my CTR.

Still, 100 MB worth of 24 kb file in 3 days. I run a small website -- that's quite a spike in traffic. What's up with that?

Any insights would be appreciated. I've written to Google three times, but received as yet no reply.

jetteroheller

12:39 pm on Mar 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Do You have one of this CMS content management systems completely programmed against search engines?

Something with

index?much-bull-#*$!-with-data-sesseion-id-and-much-other-allways-changing-data-packed-behind-into-the-query-string-behind-the-url

ironman jakarta

12:47 pm on Mar 23, 2005 (gmt 0)

10+ Year Member



Yeah Google has raped my site so far this month to the tune of 2.1gb:

1,822,704kcrawl-66-249-66-16.googlebot.com
321,804kcrawl-66-249-66-36.googlebot.com
===========
2,144,508k

I'm thinking it must be the image bot to get so much since I only have 13mb of text files. But I only have 120mb of jpgs so maybe it's wmvs too. But I only have 140mb of wmvs to it must be getting them over and over again. Must be multiple servers with getting duplicate content.

robsynnott

1:41 pm on Mar 23, 2005 (gmt 0)

10+ Year Member



Yep, it's probably an interactive content issue. Make sure it's written so that it's fairly transparent to google (URLReWriter is your friend here_

CheeseburgerBrown

4:21 pm on Mar 23, 2005 (gmt 0)

10+ Year Member



Thanks for the thoughts.

The page is just a regular old piece of static HTML, and it's been on the web and well known by Google for a couple of years. Here is an [edited] entry from my logs:

[Google IP] - - [18/Mar/2005:00:05:01 -0800] "GET [my site/my file].html HTTP/1.1" 200 22594 "http://pagead2.googlesyndication.com/pagead/ads?client=...[copious data]

I am logging thousands of these hits in a row.

CBB

DamonHD

5:02 pm on Mar 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi

At one point (years ago) Google DoSed my site by being VERY aggressive downloading images (many tens of connections at once for example) to the extent that I couldn't even get into my own site locally.

1) I wrote them an email and they fixed the problem and wrote back quickly to apologise.

2) I have put in place some very general technology (eg router traffic shaping) to make accidental or malicious DoSing by badly-written or greedy spiders less likely. Right this moment an "attack" appears to be underway on one of my mirrors and is being successfully squashed I think.

Of course, a determined and malicious hacker could easily bring my sites down, but I hope to keep at bay the merely stupid or careless, of which there are plenty (maybe an average of 1 per day since 1997 for just one of my sites?)...

Rgds

Damon

jimbeetle

5:14 pm on Mar 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



[Google IP] - - [18/Mar/2005:00:05:01 -0800] "GET [my site/my file].html HTTP/1.1" 200 22594 "http://pagead2.googlesyndication.com/pagead/ads?client=...[copious data]

This looks similar to a referral from a click on Adwords. Can anyone confirm?

Or, possibly something like Jenstar mentioned in referrals from pagead2.googlesyndication.com [webmasterworld.com].

perhaps someone is framing his site, and running AdSense in the frame - this would send the mediabot running to his site

Doesn't look like there's anything truly definitive on it yet.

jomaxx

5:36 pm on Mar 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Don't know what's going on but the AdSense spider ("Mediapartners") does not normally show a referring page.

That referrer looks more like you're showing the page as the alternate ad if no AdSense ads can be shown. Is it possible you have an ad block somewhere whose alternate page that has AdSense on it, leading to some kind of crazy infinite loop?

Jenstar

5:47 pm on Mar 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Send an email to the AdSense tech team, including the full referrals and information, so they can look into the whys and hows of it for you.

CheeseburgerBrown

6:32 pm on Mar 23, 2005 (gmt 0)

10+ Year Member



Is there a special address for the AdSense tech team?

I've already submitted three queries to Google via a web form from within the AdSense logged in area. But I have not as yet received any reply (which I found odd in and of itself, since they've historically gotten back to me promptly).

Jenstar

6:37 pm on Mar 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



adsense-tech@google.com

They might be investigating it still, which is why they haven't responded yet. But definitely send another email to the tech team.

CheeseburgerBrown

7:17 pm on Mar 23, 2005 (gmt 0)

10+ Year Member



Thanks. I've written to them again. :)

CheeseburgerBrown

2:30 am on Mar 25, 2005 (gmt 0)

10+ Year Member



Well, still no reply from Google.

I'm stripping AdLinks code out of the page.