Can Analytics Show If Search Engine Bots Have Visited My Site?

[vic_msn]

I have a 20 day old site. I have started link building and yahoo site explorer says I have over 2000 backlinks and only 1 page indexed :(
Google has indexed more than 50 pages and msn also has not indexed.
What is the problem here.
is there a way in analytics to find if robots has visited my site?

[ogletree]

Depends on what analytics you use. Mine has a section called bots. I just go there. I sometimes will set my program to only show one bot at a time so I can tell what pages it has hit. I use weblog expert. They put it under the browser section.

[conficio]

Here is the lowdown.

A log based analytics package (worth its money :) such as awstats shows you bot visits by either the requests to robots.txt or the matches to the browser ID.

If you use a script based package such as Analytics, it does not see such requests, as for robots.txt, because this does not include the script. It also does not figure (in most presumed cases) the page requests of spiders, because they don't execute Java Script code (exceptions might exist).

K<o>

[ogletree]

awstats is free but a real pain to set up and maintain.

[cgrantski]

If you can get copies of the raw logs you can open them yourself with a text editor, or Excel, or LogParser. Looking for robots.txt hits is a good place to start - just filter those in and look at the User Agent field and the IP address, either/or.