homepage Welcome to WebmasterWorld Guest from 184.73.40.21
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Oct 10-11 massive crawling - anyone?
bots hitting hard
httpwebwitch

WebmasterWorld Administrator httpwebwitch us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3109881 posted 5:44 pm on Oct 5, 2006 (gmt 0)

chime in: has anyone noticed insane amounts of bot traffic in the past 24 hours? Or any other unusually agressive behaviour?

 

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3109881 posted 6:25 pm on Oct 5, 2006 (gmt 0)

A bit heavy, but nothing out of normal bounds here. What have you seen? How far out of the ordinary is it?

selomelo

5+ Year Member



 
Msg#: 3109881 posted 6:35 pm on Oct 5, 2006 (gmt 0)

As far as my sites concerned, google was inactive for the last couple of days hitting a few pages daily. Today, I see an increase in number of pages hit. Nevertheless, it is not extraordinary. In fact, it is far below the average.

httpwebwitch

WebmasterWorld Administrator httpwebwitch us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3109881 posted 6:55 pm on Oct 5, 2006 (gmt 0)

OK - just sending out feelers, to see if something big was happening outside.

EOM

Car_Guy

5+ Year Member



 
Msg#: 3109881 posted 8:14 pm on Oct 5, 2006 (gmt 0)

In the first four days of this month, my site's robots.txt file has been accessed 888 times, for an average of 222 times a day.

Simsi

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3109881 posted 8:14 pm on Oct 5, 2006 (gmt 0)

OCT 10-11 chime in: has anyone noticed insane amounts of bot traffic in the past 24 hours? Or any other unusually agressive behaviour?

Sorry we're clearly in different time zones. Gimme 5 days to catch up and I'll let you know :-)

(but up to now, no not seen massive crawling. It's still only the 5th Oct here mind!)

nippi

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3109881 posted 8:15 pm on Oct 5, 2006 (gmt 0)

getting totally hammered by mozilla google

steveb

WebmasterWorld Senior Member steveb us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3109881 posted 8:59 pm on Oct 5, 2006 (gmt 0)

I guess I've been in a coma for a week.

trinorthlighting

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3109881 posted 10:42 pm on Oct 5, 2006 (gmt 0)

I have been getting hammered today as well!

Patrick Taylor

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3109881 posted 10:52 pm on Oct 5, 2006 (gmt 0)

Chiming in: nothing different.

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3109881 posted 12:42 am on Oct 6, 2006 (gmt 0)

People who are seeing intense crawling -- by any chance have you had (in the recent past - you can't tell today) excessive supplemental results? I'm wondering if this is another refresh of the Supplemental Index. The currently reported "broken" condition of the site: operator search makes me wonder if there's a connection.

trinorthlighting

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3109881 posted 12:43 am on Oct 6, 2006 (gmt 0)

We have quite a few supplementals (Repair parts) and we have also been adding products for the Christmas season. I will check our supplemental cache dates. It would make sense since the pages that have been crawled really hard are our supplemental pages.

trinorthlighting

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3109881 posted 12:50 am on Oct 6, 2006 (gmt 0)

Here is a strange one for you, the preffered domain kicked in on one of our sites (It does not have 301's in place) and all the pages that used to be in the regular index went supplemental. Anyone else noticing that? For some reason our google traffic is way up though....

ltedesco

10+ Year Member



 
Msg#: 3109881 posted 1:04 am on Oct 6, 2006 (gmt 0)

Oct 10-11 massive crawling - anyone?

Oh man! Where are you located?

twebdonny



 
Msg#: 3109881 posted 3:01 am on Oct 6, 2006 (gmt 0)

I sure wish we could get our supps recrawled

ann

WebmasterWorld Senior Member ann us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3109881 posted 3:10 am on Oct 6, 2006 (gmt 0)

Actually page rank was being updated today.

Ann

twebdonny



 
Msg#: 3109881 posted 3:14 am on Oct 6, 2006 (gmt 0)

It's the Florida Hurricane Recovery Effort....

walkman



 
Msg#: 3109881 posted 4:09 am on Oct 6, 2006 (gmt 0)

I have this feeling that Google will do a more comprehensive update before the holiday. Why?
Cause I said so! ;)

First, we're due for a real update.
Second, timing is perfect: not too close to Christmas not too far.

plasma

10+ Year Member



 
Msg#: 3109881 posted 8:37 am on Oct 6, 2006 (gmt 0)

Actually page rank was being updated today.

What DC? Are you sure, that it's not only the last week's PR update?

Whitey

WebmasterWorld Senior Member whitey us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 3109881 posted 8:51 am on Oct 6, 2006 (gmt 0)

Massive bot activity in last 24hrs [ Google ]
Site:tool - not working properly
Site:tool - results showing mixture of old and new data ie old meta title , current description , correct URL or v.v.
Site:tool - Disparity yesterday between regional results [ looked perfect ] and .COM [ wild and wrong ]
Site:tool - shows screwy "supplementals" returning after they were fixed [ i thought ]
PR toolbar - lowered on one site yesterday
PR others - steady
No change to traffic
Still showing filtered results

[edited by: Whitey at 8:53 am (utc) on Oct. 6, 2006]

mcskoufis

5+ Year Member



 
Msg#: 3109881 posted 9:03 am on Oct 6, 2006 (gmt 0)

Massive googlebot activity since this morning, although yahoo seems to be crawling heavy as well on all my and my customers' sites...

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved