libwww-perl

[keyplyr]

Anyone know who this is?

67.115.118.* - - [13/Aug/2004:04:49:56 -0700] "GET / HTTP/1.0" 403 199 "-" "HTTP/1.1 libwww-perl/5.48"

Whois says:
Sonic Walls Inc, Sunnyvale, CA. Thier IP allocation belongs to Pacific Bell Internet.

Thanks.

[bcolflesh]

I assume it's SonicWall:

[sonicwall.com...]

The hardware manufacturer - anyone can use libwww for spidering - do you have content related to their product on your site?

[keyplyr]

Thanks - No I don't deal with anything related to their product line at all. Their visits are frequent, and because of their location I was wondering if I should allow their IP to get through my libwww-perl block.

[coyote]

I had a SonicWall IP crawling my site a while back. It would check robots.txt and ask for non-existent pages, much like Slurp. Also, it was (trying to be) stealth with an IE/Windows user agent. I got tired of it and banned all of SW's IP range.