Welcome to WebmasterWorld Guest from 22.214.171.124 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
Had this spider visit me yesterday - only drew one file - any ideas:
Got an IP? Son_House
Maybe this is the one designfreak is talking about? Found this in our logs yesterday. Made two requests.
126.96.36.199 - - [23/Apr/2001:19:41:28 -0400] "GET /robots.txt HTTP/1.0" 200 1046 "-" "vspider"
Well these guys are wide open right now. Have a look: [ ...] 188.8.131.52 Apparently it is a canned spider/se targeted at business micro portals
From -> [
"Verity was one of the first companies to recognize the value of-and deliver-full-text search solutions for intranet, e-commerce and business portals. Our achievements come from our patented technology, long-term corporate viability, financial strength, support of industry leaders and proven success across a rich, broad customer base....blah,blah,blah..."
Same ua but different ip. Made 2 requests one of which was for robots.txt.
184.108.40.206 - "vspider"
Defense Technical Information Center
8725 John J. Kingman Road Suite 0944 Fort Belvoir, VA 22060-6218 US
Looks like this is their site: [