Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

has the bot crawled?

2:43 am on Sep 29, 2002 (gmt 0)

Junior Member

10+ Year Member

joined:Sept 25, 2002
votes: 0

When I look in my raw files, what should I see if the googlebot has crawled my site?
4:00 am on Sept 29, 2002 (gmt 0)

Moderator from GB 

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 15, 2001
votes: 24

"GET /your-directory/ HTTP/1.0" 304 - "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

This is what you should see in your logfile when googlebot crawls.


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members