Forum Moderators: open

Message Too Old, No Replies

Google Freshbot now using 216.239.*

         

rfgdxm1

4:08 am on Nov 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



216.239.46.121
216.239.46.105

Just had Googlebot grab just the home page from both my little sites from the IPs above. That IP range is usually the deep crawler. Both my sites have already been hit by the deep crawler since the update. This sort of taking just a nip of my home pages is the hallmark of the perennially nosy Google freshbot, which comes by at least once every 48 hours for some odd reason to check at least the home pages. Dunno if it is just Google doesn't trust me personally, or they do this to try and instill a constant sense of fear and dread amongst websmasters. "Googlebot is watching YOU." ;) Looks like the deep crawler is also now working for the Google Ministry of Love.

WebGuerrilla

7:17 am on Nov 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member




The 216.239 block still does random homepage/robots.txt hits. On occasions, it seems to come before a second deep crawl within a month, but quite often, it just looks like the fresh bot.

Powdork

8:41 am on Nov 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I too often get a midmonth hit on the homepage and robots.txt. Then she silently disappears from whence she came.

rfgdxm1

8:45 am on Nov 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



OK. In my case it was both sites having just the home page hit with a wham, bam, thank you ma'am by 216.239.*, which then went away. Perhaps the deep crawler bots do some extra duty when the deep crawl is finished.