Forum Moderators: mack
where do I find the logs on which search engine robots have crawled my page-especially googlebot?
Many thanks from Roly.
First you need to find the access log files that your server is creating. There is no fixed place to find these, it depends on the server you are running, and what access you have to that server.
If your site is hosted on some free ISP web space then you probably do not have acess to the logs. If you use a hosting service check their FAQs or ask technical support to show you how to access your log files.
Once you have found your logs, you need to look at the user-agent field in your log files (normally the last entry on a line), which tell you what client software requested the page. Search engines identify themselves in this field with things like "Googlebot/2.1".
If you have some log files, just load them into a text editor and search for the word "Google".
There is plenty of reference material on understanding log files. Try this search:
[google.com...]
Thanks from Roly.
