Google Spider Question

how do you know you've been visited?

[StormGuy]

How do you all track when a spider has devoured your site? Do these visits show up in our regular counter stats? If so, what do they look like?

I'm picturing a big hairy trantula in my head lol :)

[Dreamquick]

Normally their crawler shows up as GoogleBot/X.X where X's are replaced by numbers.

You'd expect to see this in your website logfiles, whether they show up on counters or not will depend on how your counter works (ie if it relies on javascript then its fairly unlikely that you'll see any search engines since none of them "do" javascript, therefore none of them will trip your counter)...

- Tony

[StormGuy]

thanks Tony :)

[cwebb]

Is there some special software out there only filtering GoogleBot stats out of log-files, of course including keywords and stuff?

[bdolnik]

If you are running windows here is a quick and free way to check. From a command prompt type:

find /I "googlebot" [drive:][path]logfile

More info on this command can be found by typing "find /?"