Forum Moderators: open

Message Too Old, No Replies

GoogleBot vs FreshBot

do they have different name in the apache access log?

         

jamesyap

10:20 am on Dec 24, 2002 (gmt 0)

10+ Year Member



Do googlebot and freshbot have different spider name in apache log files. Please give me their exact name.

Nick_W

10:22 am on Dec 24, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I don't beleive they do. You need to check the IP's
216* - Googlebot
64* - Freshbot

Nick

jamesyap

1:46 pm on Dec 24, 2002 (gmt 0)

10+ Year Member



It looks like I got both of them reaching my site for the pass 2 weeks. I thought GoogleBot only come once a month on the deep crawl? But it reach my site for a few times.

My site is new and hasn't beem ranked by google. Is this a special case for googlebot to come so frequent?

noslzzp

3:28 pm on Dec 24, 2002 (gmt 0)

10+ Year Member



Nick,

do you have examples of a more fully qualified IP address for the 216.* Googlebot IP space?

I know google doesn't have class A ip space just for its bots.

thanks..

hetzeld

3:43 pm on Dec 24, 2002 (gmt 0)

10+ Year Member



Hi noslzzp,

Here are the (216.*) bots that visited my site this month during the deepcrawl:
216.239.46.100
216.239.46.101
216.239.46.102
216.239.46.104
216.239.46.105
216.239.46.121
216.239.46.124
216.239.46.13
216.239.46.133
216.239.46.140
216.239.46.146
216.239.46.164
216.239.46.165
216.239.46.166
216.239.46.172
216.239.46.173
216.239.46.193
216.239.46.20
216.239.46.204
216.239.46.22
216.239.46.222
216.239.46.236
216.239.46.27
216.239.46.3
216.239.46.30
216.239.46.36
216.239.46.55
216.239.46.63
216.239.46.67
216.239.46.75
216.239.46.76
216.239.46.82
216.239.46.88
216.239.46.96
216.239.46.98

There must be others... including the freshbots

Dan

coconutz

5:58 pm on Dec 24, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Googlebot IP's [webmasterworld.com]

Thanks Key_Master!