homepage Welcome to WebmasterWorld Guest from 54.242.126.9
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Lots of googlebot activity 8/22 - from 3 different IPs
limoshawn

5+ Year Member



 
Msg#: 4190677 posted 3:04 am on Aug 23, 2010 (gmt 0)

we had lots of crawler activity today on a newer site, google hit the site from 3 different ip addresses throughout the day. hoping it's a good sign, never seen them use different ip addresses in the same day before.

 

Sgt_Kickaxe

WebmasterWorld Senior Member sgt_kickaxe us a WebmasterWorld Top Contributor of All Time



 
Msg#: 4190677 posted 11:50 am on Aug 23, 2010 (gmt 0)

I miss the days in which I had time and energy enough to monitor activity to this degree. Lately the only time I pay such close attention to Googlebot activities is with a test case or when something has gone horribly wrong and it reaches my bottom line.

It's fun to watch though :-)

limoshawn

5+ Year Member



 
Msg#: 4190677 posted 12:57 pm on Aug 23, 2010 (gmt 0)

Same thing today, three different google ip's crawling the site at the same time.

Bewenched

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4190677 posted 4:42 pm on Aug 23, 2010 (gmt 0)

Yea they went berzerk on our big site last thursday and friday. their fast activity notified me so I took a peek to see who was scraping the site... I've never seen Google spider so fast and from so many IP addresses, they were all valid Google ip's but there was like 10-20 of them running at once.

karter

10+ Year Member



 
Msg#: 4190677 posted 6:09 pm on Aug 23, 2010 (gmt 0)

might I ask what the average number of pages indexed per day is per gwmt for you chaps

So far , mine is circa 500,

limoshawn

5+ Year Member



 
Msg#: 4190677 posted 6:51 pm on Aug 23, 2010 (gmt 0)

last few days has been running about 4500 a day.

karter

10+ Year Member



 
Msg#: 4190677 posted 9:35 pm on Aug 23, 2010 (gmt 0)

if I may ask, are you on a dedicated server ? I read about crawl rates like yours, but have yet to see such and suppose the server type is a limiting factor .

limoshawn

5+ Year Member



 
Msg#: 4190677 posted 10:24 pm on Aug 23, 2010 (gmt 0)

yes, dedicated server, but i'm not sure that as anything to do with google's crawl rate, there are plenty of shared servers that can handle heavy traffic.

devil_dog

5+ Year Member



 
Msg#: 4190677 posted 1:41 pm on Aug 24, 2010 (gmt 0)

Ive always been seeing 10+ Googlebot IPs every minute... I run a fairly decent sized site with many pages added constantly... The bot fetches > 100 requests/minute

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved