homepage Welcome to WebmasterWorld Guest from 54.166.100.8
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Googlebot
Google but not Googlebot
vortech




msg:3010272
 9:27 am on Jul 16, 2006 (gmt 0)

Just hit my spider trap

72.14.192.aa

UA: mozilla/5.0 (windows; u; windows nt 5.1; en-us; rv:1.8.0.4) gecko/20060508
firefox/1.5.0.4

IP lookup says Google Inc.

Any ideas? Don't know what going on.

Vortech

 

GaryK




msg:3010413
 2:44 pm on Jul 16, 2006 (gmt 0)

Did you analyze its behavior to see if it looked like a bot or a human? That's gonna be the only real way to tell what this user agent was doing.

My guess would be it was just a Google employee surfing your site with Firefox.

The only thing that makes me wonder if I'm correct is it fell into a spider trap.

[edited by: GaryK at 2:45 pm (utc) on July 16, 2006]

thetrasher




msg:3010511
 4:11 pm on Jul 16, 2006 (gmt 0)

GWA = Google Web Accelerator
[webmasterworld.com ]

Googlebot doesn't need an accelerator.

vortech




msg:3010548
 4:55 pm on Jul 16, 2006 (gmt 0)

Thanks Trasher,

I guess thats it. It's going to fall into my trap every time. I'm going to have to give this some thought as to whether to block it or not. I don't want to block, but my spider trap works great.

Thanks,

vortech

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved