Welcome to WebmasterWorld Guest from 54.167.65.217

Message Too Old, No Replies

How do you check if robots are visiting site

     
11:14 am on Aug 24, 2005 (gmt 0)

New User

10+ Year Member

joined:Aug 6, 2005
posts:32
votes: 0


Hi
Simple question (I hope..) but cant find the answer anywhere.
How do you check if robots are visiting the site?
Reagrds
Shaun
8:12 am on Aug 28, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 23, 2003
posts:801
votes: 0


Do you have access to the server logs? They contain all you need to know.

If you have a Free ISP, where such information is not made public to you, I'm not aware of a way that you can find out, as most of the "other" tricks like clever PHP will not be available to you.

The "fresh date" (the date in green) in the Google results for your site (try allinurl:www.yoursite.fiddlybits) will tell you which pages have been visited in the last two days or so. (After that the dates will vanish)
DerekH

1:21 am on Aug 29, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 12, 2002
posts:4479
votes: 0


>Do you have access to the server logs? They contain all you need to know.

Yep. It'll all be in the logs. And Googlebot is a nuisance. For whatever reason, it is frequently all over a couple simple amateur sites I run. I used to think Google didn't trust me. I've concluded that Googlebot is just hungry, and this is her way.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members