homepage Welcome to WebmasterWorld Guest from 54.196.159.11
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Over Zealous GoogleBot
keyplyr




msg:745861
 9:31 am on Mar 29, 2005 (gmt 0)

I have 160 page site that normally gets a few pages (10-20) crawled twice a week, and a full crawl once a month.

In the last 4 hours, GoogleBot has hit every page 3 or more times and robots.txt 60 times. Anybody else seeing this craziness?

 

Brett_Tabke




msg:745862
 2:27 pm on Apr 5, 2005 (gmt 0)

Ya, there were alot of people that reported a strong Gbot presence last week.

lost in space




msg:745863
 7:03 pm on Apr 5, 2005 (gmt 0)

GBot is killing one of my servers with this also, they've been hitting one of my sites 30,000 times per day for about the last 10 days, it keeps causing my CPU to overheat, I think they're trying to catch my server on fire :)

jnmconsulting




msg:745864
 7:19 pm on Apr 5, 2005 (gmt 0)

are we sure it is an actuall google bot, best way to tell is by IP not the useragent! I had this happen a few weeks ago and found it was an ip that was assigned to comcast cable and not google.

walkman




msg:745865
 7:21 pm on Apr 5, 2005 (gmt 0)

I think before and after a major update this happens.

BillyS




msg:745866
 7:45 pm on Apr 5, 2005 (gmt 0)

I think before and after a major update this happens.

My experience exactly.

itisgene




msg:745867
 8:30 pm on Apr 5, 2005 (gmt 0)

So, is it before or after?
I didn't care much about the Allegra anyways...but who knows? My sandboxed sites may get out if there is another update.

walkman




msg:745868
 8:55 pm on Apr 5, 2005 (gmt 0)

before and after

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved