Welcome to WebmasterWorld Guest from 107.20.34.173

Message Too Old, No Replies

Oct 10-11 massive crawling - anyone?

bots hitting hard

     

httpwebwitch

5:44 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Administrator httpwebwitch is a WebmasterWorld Top Contributor of All Time 10+ Year Member



chime in: has anyone noticed insane amounts of bot traffic in the past 24 hours? Or any other unusually agressive behaviour?

tedster

6:25 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



A bit heavy, but nothing out of normal bounds here. What have you seen? How far out of the ordinary is it?

selomelo

6:35 pm on Oct 5, 2006 (gmt 0)

10+ Year Member



As far as my sites concerned, google was inactive for the last couple of days hitting a few pages daily. Today, I see an increase in number of pages hit. Nevertheless, it is not extraordinary. In fact, it is far below the average.

httpwebwitch

6:55 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Administrator httpwebwitch is a WebmasterWorld Top Contributor of All Time 10+ Year Member



OK - just sending out feelers, to see if something big was happening outside.

EOM

Car_Guy

8:14 pm on Oct 5, 2006 (gmt 0)

5+ Year Member



In the first four days of this month, my site's robots.txt file has been accessed 888 times, for an average of 222 times a day.

Simsi

8:14 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



OCT 10-11 chime in: has anyone noticed insane amounts of bot traffic in the past 24 hours? Or any other unusually agressive behaviour?

Sorry we're clearly in different time zones. Gimme 5 days to catch up and I'll let you know :-)

(but up to now, no not seen massive crawling. It's still only the 5th Oct here mind!)

nippi

8:15 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



getting totally hammered by mozilla google

steveb

8:59 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Senior Member steveb is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I guess I've been in a coma for a week.

trinorthlighting

10:42 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



I have been getting hammered today as well!

Patrick Taylor

10:52 pm on Oct 5, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Chiming in: nothing different.

tedster

12:42 am on Oct 6, 2006 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



People who are seeing intense crawling -- by any chance have you had (in the recent past - you can't tell today) excessive supplemental results? I'm wondering if this is another refresh of the Supplemental Index. The currently reported "broken" condition of the site: operator search makes me wonder if there's a connection.

trinorthlighting

12:43 am on Oct 6, 2006 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



We have quite a few supplementals (Repair parts) and we have also been adding products for the Christmas season. I will check our supplemental cache dates. It would make sense since the pages that have been crawled really hard are our supplemental pages.

trinorthlighting

12:50 am on Oct 6, 2006 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Here is a strange one for you, the preffered domain kicked in on one of our sites (It does not have 301's in place) and all the pages that used to be in the regular index went supplemental. Anyone else noticing that? For some reason our google traffic is way up though....

ltedesco

1:04 am on Oct 6, 2006 (gmt 0)

10+ Year Member



Oct 10-11 massive crawling - anyone?

Oh man! Where are you located?

twebdonny

3:01 am on Oct 6, 2006 (gmt 0)



I sure wish we could get our supps recrawled

ann

3:10 am on Oct 6, 2006 (gmt 0)

WebmasterWorld Senior Member ann is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Actually page rank was being updated today.

Ann

twebdonny

3:14 am on Oct 6, 2006 (gmt 0)



It's the Florida Hurricane Recovery Effort....

walkman

4:09 am on Oct 6, 2006 (gmt 0)



I have this feeling that Google will do a more comprehensive update before the holiday. Why?
Cause I said so! ;)

First, we're due for a real update.
Second, timing is perfect: not too close to Christmas not too far.

plasma

8:37 am on Oct 6, 2006 (gmt 0)

10+ Year Member



Actually page rank was being updated today.

What DC? Are you sure, that it's not only the last week's PR update?

Whitey

8:51 am on Oct 6, 2006 (gmt 0)

WebmasterWorld Senior Member whitey is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Massive bot activity in last 24hrs [ Google ]
Site:tool - not working properly
Site:tool - results showing mixture of old and new data ie old meta title , current description , correct URL or v.v.
Site:tool - Disparity yesterday between regional results [ looked perfect ] and .COM [ wild and wrong ]
Site:tool - shows screwy "supplementals" returning after they were fixed [ i thought ]
PR toolbar - lowered on one site yesterday
PR others - steady
No change to traffic
Still showing filtered results

[edited by: Whitey at 8:53 am (utc) on Oct. 6, 2006]

mcskoufis

9:03 am on Oct 6, 2006 (gmt 0)

10+ Year Member



Massive googlebot activity since this morning, although yahoo seems to be crawling heavy as well on all my and my customers' sites...
 

Featured Threads

Hot Threads This Week

Hot Threads This Month