Welcome to WebmasterWorld Guest from 18.104.22.168
The M_Bot [webmasterworld.com] (identified by
Mozilla/5.0 (compatible; Googlebot/2.1; in the referer string) had been hitting my site at upto 3 times/sec (avg: 836/day), triggering unruly-bot-prevention routines [webmasterworld.com] in the PHP-scripts. I had used the G on-site form [google.com] a few days before, and asked them (nicely) to stop it. So far so good.
By July 1 it was clear that--rather than turning the knob down a notch or two--they had switched it off altogether, at least as far as the M_Bot was concerned - there were no hits from this bot at all. The G_Bot (identified just by
Googlebot/2.1 (+http://www.google.com/bot.html) in the referer string) had also slowed:
So, my site has now dropped from 28,000 G-hits in June to a likely 500 in July. So, beware...
That is now 4 threads (including this one) with numerous people reporting excessive bandwidth.
It is worth reporting that the number of pages resulting from G-SERPs on my site is actually up:
To rub salt in my wounds, all M_Bot hits on my site in Sept are 301s and 404s for pages that have never existed on my site, ever. Here are 3 typical examples:
GET /topsites.php?ID=259 HTTP/1.1" 404 610
"GET /out.php?ID=1 HTTP/1.1" 404 610
"GET /index.shtml HTTP/1.1" 404 610
Here are the number of pages/day from G on my site:
...and the number of pages to G:
Seeing the slow death of hits from G has shifted something in my attitude to Google. I can no longer be counted as one of their supporters. And, whilst that statement is unlikely to cause G's knees to tremble, I think that maybe it should. We all need all the help that we can get from other people of goodwill, and I think that it is a shame that such intelligent people should, in the end, prove to be so ignorant.
which begins to look like slow death
Pages supplied from Google halved yesterday. No-one else reported a sudden change, so it must be personal to my site.
Here are stats for September; 1st column is upto and including 21st, 2nd column is 22nd:
Search Avg 22nd
------ ---- ----
Google 1650 824
Yahoo. .234 231
MSN... ..90 .91