Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

has the bot crawled?



2:43 am on Sep 29, 2002 (gmt 0)

10+ Year Member

When I look in my raw files, what should I see if the googlebot has crawled my site?


4:00 am on Sep 29, 2002 (gmt 0)

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

"GET /your-directory/ HTTP/1.0" 304 - "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

This is what you should see in your logfile when googlebot crawls.


Featured Threads

Hot Threads This Week

Hot Threads This Month