Forum Moderators: open
Most hosts will have some kind of control panel, or web page where you can view your sites statistics.
THe stats are generated by softwhere from the raw log file (which you may be able to download yourself and analize with your own software).
The log file contains an entry for every request to the server and records very useful stuff like:
Hope that helps ;)
Nick
My hosting service has webtrends. It has a section for visiting spiders. However, Googlebot does not show as a spider but as a browser on the area of the log that gives stats on visiting browsers.
The report looks like this
Googlebot/2.1 ( [googlebot.com...] 191 0.05% 146
191 hits and 146 visits.
I'm not sure how to determine whether I have been deep crawled or how many pages have been crawled.
? or what is the significance of hits v. visits.
I'm not real familiar with Webtrends but basically a visits are series of hits from the same IP number in a certain amount of time.
Were you deep crawled? Depends. Webtrends may read several bots in a single session as many hits and many visits when it was in fact a fairly deep crawl.
Hope that helps...
[webmasterworld.com...]
It's a great resource -- happy reading!