homepage Welcome to WebmasterWorld Guest from 54.166.10.100
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
New Googlebot UA
jcoronella




msg:403826
 9:48 pm on Aug 10, 2004 (gmt 0)

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

From: 64.68.81.*** and 64.68.83.***

 

WarmGlow




msg:403827
 12:32 am on Aug 11, 2004 (gmt 0)

jcoronella,

Thanks very much for the heads-up.
I changed my Analog configuration from:
ROBOTINCLUDE Googlebot*

to:
ROBOTINCLUDE REGEXPI:Googlebot

Robino




msg:403828
 2:08 pm on Aug 12, 2004 (gmt 0)


This robot has been eating heavily on one of my sites for the last three days.

60,000+ pages! This is about three times the number of pages it's gobbled in the past.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved