Welcome to WebmasterWorld Guest from 54.197.66.254

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

what kind of spider is it if at all?

     
12:33 am on Jan 27, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 12, 2000
posts:116
votes: 0


suproxy.google.com - - [26/Jan/2001:17:04:59 -0500] "GET /...html HTTP/1.0" 200 13087 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

is it a spider or google personel surfing!
thanks g

2:27 pm on Jan 27, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 19, 2000
posts:193
votes: 0


That seems to be a spider.

Google personnel surfing does not show up as googlebot.

Also, would googlep personnel request a robots.txt file?

2:42 pm on Jan 27, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 12, 2000
posts:116
votes: 0


thanks, for the info i just never seen suproxy,
i always see crawler#.googlebot

thank you again
g