Well for one I know all yahoo store owners dont have access to raw logs to see when they were crawled.. I am not sure how many other people out their have the same problem but I am wondering if their is a work around to this. It really stinks when you are updating and arent even sure if googlebots already been by to visit as you pull days of all nighters (literally) trying to get things done to only find out googlebot crawled you this month already...
I have come accross this script...
if(eregi("google",$HTTP_USER_AGENT))
{
mail("youremailaddress@yourdomain.com", "Googlebot detected");}
I'm not sure how to implement it or if it would even be a good idea. Anyone else use this or have other ideas?