Welcome to WebmasterWorld Guest from 50.16.24.12

Forum Moderators: Ocean10000 & incrediBILL

what kind of spider is it if at all?

   
12:33 am on Jan 27, 2001 (gmt 0)

10+ Year Member



suproxy.google.com - - [26/Jan/2001:17:04:59 -0500] "GET /...html HTTP/1.0" 200 13087 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

is it a spider or google personel surfing!
thanks g

2:27 pm on Jan 27, 2001 (gmt 0)

10+ Year Member



That seems to be a spider.

Google personnel surfing does not show up as googlebot.

Also, would googlep personnel request a robots.txt file?

2:42 pm on Jan 27, 2001 (gmt 0)

10+ Year Member



thanks, for the info i just never seen suproxy,
i always see crawler#.googlebot

thank you again
g

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month