Ip:199.245.188.74

UA: libwww-perl/5.50

[roscoepico]

This is what I have:
Visitor IP: 199.245.188.74
UA: libwww-perl/5.50

Internet Products, Inc. (NET-IPINC-NET)
8947-A Complex Drive
San Diego, Ca 92123

The reason why I am questioning it is because it is hitting a large(hundreds) amount sites we are doing work for. Has anyone else seen this in there logs? Just seems awefully suspect

[skirril]

libwww-perl is a perl module for http access. It looks to me like a "homemade" bot (all bots are "homemade" at some point), whose author didnt bother inventing a name.A libwww/perl homepage can be found at [url="http://www.linpro.no/lwp/"¨]http://www.linpro.no/lwp/[/url].

does it honor the robots exclusion std?
how much load does it place on servers? (today had a bot doing 5 requuests a sec, not honoring robots.txt, or meta robots std.)

Please be aware that the web is essentially a public medium, so if you do not want to spread certain information, do not put it on the web.

[roscoepico]

Thanks for the info. I am very much aware of what you mentioned in your post, my question is whether or not anyone here has seen the same bot hitting there sites. It has been comming around the same time every night and my thinking is that it may be related to a known search engine(maybe AV trying to be sneaky), since it is hitting sites that have only been submitted to AV and have not made there way into any other indices...

[littleman]

NS lookup -> cachebox.ipinc.com

I did a quick scan over 80 domains and I haven't seen it.
Google is great for finding dirt on IPs [google.com].

If you take the NS lookup at face value it's a cache server for ipinc.com [ipinc.com]. But that makes the UA kinda wacky. How many proxy/cache servers are running LWP?