has the bot crawled? - (deprecated) Google News Archive forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

has the bot crawled?

HollyHats

2:43 am on Sep 29, 2002 (gmt 0)

10+ Year Member

When I look in my raw files, what should I see if the googlebot has crawled my site?

mack

4:00 am on Sep 29, 2002 (gmt 0)

WebmasterWorld Administrator

10+ Year Member

Top Contributors Of The Month

"GET /your-directory/ HTTP/1.0" 304 - "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

This is what you should see in your logfile when googlebot crawls.