Page is a not externally linkable
- Google
-- Google News Archive
---- has the bot crawled?


mack - 4:00 am on Sep 29, 2002 (gmt 0)


"GET /your-directory/ HTTP/1.0" 304 - "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

This is what you should see in your logfile when googlebot crawls.


Thread source:: http://www.webmasterworld.com/google_archive/5718.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com