homepage Welcome to WebmasterWorld Guest from 54.167.185.110
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
A new visitor from Google?
Hopefully the unblocking agent!
makemetop




msg:405372
 1:31 pm on Jan 12, 2001 (gmt 0)

Not in Brett's files. I wonder if anyone else has seen this...

64-208-38-2.google.com - - [11/Jan/2001:16:53:38 -0500] "GET / HTTP/1.0" 200 20848 "-" "Java1.2.2"
64-208-38-2.google.com - - [11/Jan/2001:16:53:39 -0500] "GET /robots.txt HTTP/1.0" 404 204 "-" "Java1.2.2"

and what might it be doing?

 

Fusioneer




msg:405373
 1:56 pm on Jan 12, 2001 (gmt 0)

I was visited by the same IP/UA after an email to search-quality@google.com,see my post here:

[webmasterworld.com...]

In my case I am 99% sure it was a google employee surfing from a linux box - it did not get robots.txt and retrieved images, flash etc. and browsed for a couple of minutes like a human surfer.

Yours has a different UA however...hmmm

Hope this helps.

makemetop




msg:405374
 12:15 am on Jan 13, 2001 (gmt 0)

Thanks.

However, as you can see, this acted like a spider. No graphics etc were picked up and the UA is very strange. It is obviously related to Google Technical as this too occured shortly after an e-mail to search-quality@google.com.

JonB




msg:405375
 6:36 am on Jan 13, 2001 (gmt 0)

Maybe after you send them e-mail asking about your positions etc they send out "special" spider who visits faster and not like regular Google spider bot. What were your questions to google- about your listing?

Fusioneer




msg:405376
 9:23 am on Jan 13, 2001 (gmt 0)

I was emailing them about the GOOGLEBOT NOARCHIVE tag affecting results, ie. very few results in top 10 without Cached version of page.

Spiders also don't eat cookies - which this visitor did. My opinion is that it was a Google employee (in my case). I'm sure it was no coincidence after an email to search-quality@google.com .

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved