This ip 184.108.40.206, which looks like a vario dialup user or a hosted client machine to me, has been grabbing 2-400 pages a day. Never any graphics so my guess is some type of robot, always gets pages in groups(same page 2-4 times). Works like clockwork getting 46 pages at a visit serveral times a day.
That IP belongs to AvantGo. They are a channel provider for Pocket PC and Palm users. Basically what happens is AvantGo comes and caches your site and then when handheld users sync their units they get the website from AvantGo and can offline browse it during the day.
AFAIK AvantGo does not go out and look for sites. You have to sign up with them. When you do create a channel with them you can specify how often and how deep they spider your site.
Thank for the speedy reply oilman. I don't know how they would start grabbing my site. The domain name for this site is only 2 months old and on an IP which has been unused for 2 years. I am starting to actively promot the site now, but I doubt I'm in Avantgo's system that quick, who knows. Maybe they did find the site and like the service??
How did you come up with Avantgo??
AvantGo Inc. (NETBLK-AVANTGO-NETBLK1) AVANTGO-NETBLK1 220.127.116.11 - 18.104.22.168
The ip block I see is owned by Vario
Netblock: 22.214.171.124 - 126.96.36.199 Maintainer: Verio, Inc.
Maybe its just Avantgo leasing or hosting a machine at Vario??
Thanks again, I'll just send an email to both of them to find out.