Welcome to WebmasterWorld Guest from 23.22.46.195

How do you check if robots are visiting site

   
11:14 am on Aug 24, 2005 (gmt 0)

5+ Year Member



Hi
Simple question (I hope..) but cant find the answer anywhere.
How do you check if robots are visiting the site?
Reagrds
Shaun
8:12 am on Aug 28, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do you have access to the server logs? They contain all you need to know.

If you have a Free ISP, where such information is not made public to you, I'm not aware of a way that you can find out, as most of the "other" tricks like clever PHP will not be available to you.

The "fresh date" (the date in green) in the Google results for your site (try allinurl:www.yoursite.fiddlybits) will tell you which pages have been visited in the last two days or so. (After that the dates will vanish)
DerekH

1:21 am on Aug 29, 2005 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>Do you have access to the server logs? They contain all you need to know.

Yep. It'll all be in the logs. And Googlebot is a nuisance. For whatever reason, it is frequently all over a couple simple amateur sites I run. I used to think Google didn't trust me. I've concluded that Googlebot is just hungry, and this is her way.

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month