How Can I Tell if Google is "Crawling" My Site?

[Webseeker]

I see several making comments about Google crawling their sites, sometimes only a couple of pages... then maybe coming back the next month or so and crawling "deeper", etc.

How do I check or know when Google comes to my site? From the sounds of it, Googlebots do this regularly...monthly?

Thanks,

Webseeker

[bill]

Welcome to WebmasterWorld Webseeker!

You need access to your log files on your host. The location varies, but often there is a /logs/ folder in your account. Open the log files in a text editor like NotePad and search for the lines containing "googlebot". That will show you the dates and times of its visits to various pages in your site.

This is a super basic explanation. Check our Tracking and Logging [webmasterworld.com] forum for more in-depth discussion of ways to track visitors to your site.

[Webseeker]

Hello Bill,

Gee, 27 minutes. If you were really good, you'd cut that wait time to under 20.

LOL!

Thanks for your reply. The webhost I used seemingly really have things organized very well for me in the control panel. I spent 15 minutes in there looking over the files. I have a statistics counter program on my website that is very informative, but it did not get into some of the details I found in my log files in my control panel. I see Googlebots came there once in April and twice so far this month in May.

Thanks for the tip. It is very helpful!

Webseeker

"Nice Forum.... very nice!"