homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

This 31 message thread spans 2 pages: < < 31 ( 1 [2]     
Is Google now using Chrome to crawl the web ?

Msg#: 3760236 posted 5:11 am on Oct 7, 2008 (gmt 0)

Haven't posted in a long time. Thought i would drop in to report a very interesting Google activity I've been observing today.

I have an "who's online" script running and reporting visitors in real time as they browse the site. The script uses javascript to report referrer and currently viewed page.

One of the visitors today was from [google.com] sucking approx 200 pages in a 15-20 minutes frame and invoking the on page tracking javascript....sending referring page and current URL information (it had to invoke javascript just like a browser would to do that). In other words acting very much like it is a full on browser.

Maybe it is already old news to some, maybe i missed previous topics disscussing this. Anyway, it is the first time i see this thing in real time. Very interesting crawl development.

Anyone else noticed this ?

Page to page browsing was occuring at a very fast rate, could not be human.



WebmasterWorld Senior Member 10+ Year Member

Msg#: 3760236 posted 7:11 pm on Oct 20, 2008 (gmt 0)

jecasc - What identified this as a Google crawler?

The "who is online" shows the IP. I checked the IP on an IP lookup website and the IP was from Google. Also the requests came so fast that it could not possibly be a human search. Perhaps I would not have even noticed it if the search terms would not have been so odd. I also checked if there was a website somewhere linking to my website with the search terms, but I found none.

The whois online is not javascript based however like Web_speed's. (It is an oscommerce webshop.)

I have checked my logfiles of the past days and I found the same happening a few days ago:

User Agent: "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

This 31 message thread spans 2 pages: < < 31 ( 1 [2]
Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved