homepage Welcome to WebmasterWorld Guest from 54.237.134.62
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Oct 10-11 massive crawling - anyone?
bots hitting hard
httpwebwitch




msg:3109883
 5:44 pm on Oct 5, 2006 (gmt 0)

chime in: has anyone noticed insane amounts of bot traffic in the past 24 hours? Or any other unusually agressive behaviour?

 

tedster




msg:3109936
 6:25 pm on Oct 5, 2006 (gmt 0)

A bit heavy, but nothing out of normal bounds here. What have you seen? How far out of the ordinary is it?

selomelo




msg:3109946
 6:35 pm on Oct 5, 2006 (gmt 0)

As far as my sites concerned, google was inactive for the last couple of days hitting a few pages daily. Today, I see an increase in number of pages hit. Nevertheless, it is not extraordinary. In fact, it is far below the average.

httpwebwitch




msg:3109976
 6:55 pm on Oct 5, 2006 (gmt 0)

OK - just sending out feelers, to see if something big was happening outside.

EOM

Car_Guy




msg:3110038
 8:14 pm on Oct 5, 2006 (gmt 0)

In the first four days of this month, my site's robots.txt file has been accessed 888 times, for an average of 222 times a day.

Simsi




msg:3110039
 8:14 pm on Oct 5, 2006 (gmt 0)

OCT 10-11 chime in: has anyone noticed insane amounts of bot traffic in the past 24 hours? Or any other unusually agressive behaviour?

Sorry we're clearly in different time zones. Gimme 5 days to catch up and I'll let you know :-)

(but up to now, no not seen massive crawling. It's still only the 5th Oct here mind!)

nippi




msg:3110040
 8:15 pm on Oct 5, 2006 (gmt 0)

getting totally hammered by mozilla google

steveb




msg:3110091
 8:59 pm on Oct 5, 2006 (gmt 0)

I guess I've been in a coma for a week.

trinorthlighting




msg:3110301
 10:42 pm on Oct 5, 2006 (gmt 0)

I have been getting hammered today as well!

Patrick Taylor




msg:3110317
 10:52 pm on Oct 5, 2006 (gmt 0)

Chiming in: nothing different.

tedster




msg:3110388
 12:42 am on Oct 6, 2006 (gmt 0)

People who are seeing intense crawling -- by any chance have you had (in the recent past - you can't tell today) excessive supplemental results? I'm wondering if this is another refresh of the Supplemental Index. The currently reported "broken" condition of the site: operator search makes me wonder if there's a connection.

trinorthlighting




msg:3110390
 12:43 am on Oct 6, 2006 (gmt 0)

We have quite a few supplementals (Repair parts) and we have also been adding products for the Christmas season. I will check our supplemental cache dates. It would make sense since the pages that have been crawled really hard are our supplemental pages.

trinorthlighting




msg:3110398
 12:50 am on Oct 6, 2006 (gmt 0)

Here is a strange one for you, the preffered domain kicked in on one of our sites (It does not have 301's in place) and all the pages that used to be in the regular index went supplemental. Anyone else noticing that? For some reason our google traffic is way up though....

ltedesco




msg:3110405
 1:04 am on Oct 6, 2006 (gmt 0)

Oct 10-11 massive crawling - anyone?

Oh man! Where are you located?

twebdonny




msg:3110483
 3:01 am on Oct 6, 2006 (gmt 0)

I sure wish we could get our supps recrawled

ann




msg:3110492
 3:10 am on Oct 6, 2006 (gmt 0)

Actually page rank was being updated today.

Ann

twebdonny




msg:3110495
 3:14 am on Oct 6, 2006 (gmt 0)

It's the Florida Hurricane Recovery Effort....

walkman




msg:3110516
 4:09 am on Oct 6, 2006 (gmt 0)

I have this feeling that Google will do a more comprehensive update before the holiday. Why?
Cause I said so! ;)

First, we're due for a real update.
Second, timing is perfect: not too close to Christmas not too far.

plasma




msg:3110671
 8:37 am on Oct 6, 2006 (gmt 0)

Actually page rank was being updated today.

What DC? Are you sure, that it's not only the last week's PR update?

Whitey




msg:3110682
 8:51 am on Oct 6, 2006 (gmt 0)

Massive bot activity in last 24hrs [ Google ]
Site:tool - not working properly
Site:tool - results showing mixture of old and new data ie old meta title , current description , correct URL or v.v.
Site:tool - Disparity yesterday between regional results [ looked perfect ] and .COM [ wild and wrong ]
Site:tool - shows screwy "supplementals" returning after they were fixed [ i thought ]
PR toolbar - lowered on one site yesterday
PR others - steady
No change to traffic
Still showing filtered results

[edited by: Whitey at 8:53 am (utc) on Oct. 6, 2006]

mcskoufis




msg:3110693
 9:03 am on Oct 6, 2006 (gmt 0)

Massive googlebot activity since this morning, although yahoo seems to be crawling heavy as well on all my and my customers' sites...

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved