homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum in my logs today

 8:21 pm on Aug 27, 2011 (gmt 0) hit my site today about 10 minutes ago.

It's labeled as:

Google (
The Dalles, Oregon, United States, 0 returning visits

27th August 2011
Page View
No referring link

It hit my site on the homepage, with no referrer, and didn't go to any other page.

When I looked up the IP, it was somewhere in the UK, but this labeled it as Oregon.

Is this just another GBOT?



 11:19 pm on Aug 27, 2011 (gmt 0)

The entire 74.125., 72.14. and some other IP tanges are used by Google Tools, which provide some services for users.

There's a recent thread were this part of either Google Ads or GWT.

Generally speaking, a webmaster doesn't want theses ranges crawling their site (s), as anybody could be using the tools without identifying themselves.


 7:36 pm on Aug 28, 2011 (gmt 0)

It's not a bot - at least, not a "legal" one. What was the UA? That is usually more indicative than the referer.

74.etc is US not UK but it is part of google. If it comes in with a credible UA and headers I usually give it access, unless it's locked itself out by doing something anti-social.

How did you get UK and Oregon?


 9:16 pm on Aug 28, 2011 (gmt 0)

Looks like the UA was probably related to G's translation 'services'... From Project Honey Pot for the OP's IP, (Google; Mountain View, CA) [projecthoneypot.org...] --

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.xxx),gzip(gfe) (via translate.google.com)
Mozilla/5.0 (X11; U; Linux i686; en-US; Nautilus/1.0Final),gzip(gfe) (via translate.google.com)
Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9a8),gzip(gfe) (via translate.google.com)

"translate.google.com" has a history of being a back door for bad eggs.


 10:50 pm on Aug 29, 2011 (gmt 0)

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} trans
RewriteRule .* - [F]


 9:11 pm on Aug 30, 2011 (gmt 0)

Sadly I have to allow translate for one of my clients, but the IPs it uses are increasingly being killed for other misuse.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved