Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Google bombed or a spoofed attack?

23k+ spider visits today!?!



2:09 am on Aug 27, 2004 (gmt 0)

10+ Year Member

What the heck is going on? I'm currently seeing my 4th huge spike in visits from (crawl31.googlebot.com). After receiving 1100 visits from the Googlebot all last month, I have 23k+ and rising TODAY. The latest was a 2Mbps spike with about 2500 visits to phpBB faq.php file.

The spike is still going on with a large number of visits to my login.php and index.php. If it's DoS, it's a bad one as it's not putting a dent in my server resources or bandwidth. The previous spikes were much smaller, averaging under a .5 Mbps for a couple hours, each.

I don't think it would be someone trying to brute force a password, as the phpBB site contains nothing of value.

So my question is, have others ever seen something like this? One thing I will say is that my site is about 3 months old and I'm expecting a pretty good size PR jump to certainly 6, maybe 7. But I doubt that has something to do with it.




2:12 pm on Aug 27, 2004 (gmt 0)

10+ Year Member

Just an update on this. After 4 spikes yesterday, I've not had one today. To me, it is looking less like a spoofed attack or something and looking more like Google just pounding my site for some unknown reason.

I think the spider had some brain damage or something ;-)

Anyone heard of something similar?



2:33 pm on Aug 27, 2004 (gmt 0)

10+ Year Member

One of my sites was closed down by my hosting company two weeks ago, they informed me that they'd had a DOS attack from the ip range

The site is running again now, but all googlebots are banned!


2:37 pm on Aug 27, 2004 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

If you're using session IDs, make sure you don't give them to spiders. A session ID, depending on how you implement it, can create millions of URLs for the same page, each seeming to be a unique URL.



2:51 pm on Aug 27, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Sounds like it must be some kind session ID/spidertrap issue.

I have been getting that many hits (or more) from Google each day for the past two weeks. I'm pretty regularly seeing about 60,000 page views a day from various search engines. But I also have a lot of pages so it makes plenty of sense. Based on your description, it would appear you have a lot fewer pages and it is just repeatedly hammering individual pages. Correct?


3:02 pm on Aug 27, 2004 (gmt 0)

10+ Year Member

That's sounds like exactly the problem. It was the same few pages over and over again, but the bot was probably getting different session id's. Totally makes sense, and I should be able to correct that.



Featured Threads

Hot Threads This Week

Hot Threads This Month