Page is a not externally linkable
- Google
-- Google News Archive
---- Gbot running hard


boredguru - 7:38 pm on Sep 24, 2004 (gmt 0)


Just took time to analyse the stats.
what i found was that once all the pages were crawled by 66.249.65 bot, then a few pages were immediately crawled by the 216.239.37 and the few pages that were crawled by this bot started appearing in the SERPs within hours (six - ten)
Whats going on.

[edited by: boredguru at 7:43 pm (utc) on Sep. 24, 2004]


Thread source:: http://www.webmasterworld.com/google_archive/25897.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com