|Google bombed or a spoofed attack?|
23k+ spider visits today!?!
| 2:09 am on Aug 27, 2004 (gmt 0)|
What the heck is going on? I'm currently seeing my 4th huge spike in visits from 220.127.116.11 (crawl31.googlebot.com). After receiving 1100 visits from the Googlebot all last month, I have 23k+ and rising TODAY. The latest was a 2Mbps spike with about 2500 visits to phpBB faq.php file.
The spike is still going on with a large number of visits to my login.php and index.php. If it's DoS, it's a bad one as it's not putting a dent in my server resources or bandwidth. The previous spikes were much smaller, averaging under a .5 Mbps for a couple hours, each.
I don't think it would be someone trying to brute force a password, as the phpBB site contains nothing of value.
So my question is, have others ever seen something like this? One thing I will say is that my site is about 3 months old and I'm expecting a pretty good size PR jump to certainly 6, maybe 7. But I doubt that has something to do with it.
| 2:12 pm on Aug 27, 2004 (gmt 0)|
Just an update on this. After 4 spikes yesterday, I've not had one today. To me, it is looking less like a spoofed attack or something and looking more like Google just pounding my site for some unknown reason.
I think the spider had some brain damage or something ;-)
Anyone heard of something similar?
| 2:33 pm on Aug 27, 2004 (gmt 0)|
One of my sites was closed down by my hosting company two weeks ago, they informed me that they'd had a DOS attack from the ip range 18.104.22.168-255
The site is running again now, but all googlebots are banned!
| 2:37 pm on Aug 27, 2004 (gmt 0)|
If you're using session IDs, make sure you don't give them to spiders. A session ID, depending on how you implement it, can create millions of URLs for the same page, each seeming to be a unique URL.
| 2:51 pm on Aug 27, 2004 (gmt 0)|
Sounds like it must be some kind session ID/spidertrap issue.
I have been getting that many hits (or more) from Google each day for the past two weeks. I'm pretty regularly seeing about 60,000 page views a day from various search engines. But I also have a lot of pages so it makes plenty of sense. Based on your description, it would appear you have a lot fewer pages and it is just repeatedly hammering individual pages. Correct?
| 3:02 pm on Aug 27, 2004 (gmt 0)|
That's sounds like exactly the problem. It was the same few pages over and over again, but the bot was probably getting different session id's. Totally makes sense, and I should be able to correct that.