homepage Welcome to WebmasterWorld Guest from 54.211.230.186
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Vspider
designfreak

10+ Year Member



 
Msg#: 579 posted 9:18 am on Apr 22, 2001 (gmt 0)

Had this spider visit me yesterday - only drew one file - any ideas:

Vspider

thanks

design freak

 

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 579 posted 9:28 am on Apr 22, 2001 (gmt 0)

Got an IP?

Son_House

10+ Year Member



 
Msg#: 579 posted 3:15 pm on Apr 24, 2001 (gmt 0)

Maybe this is the one designfreak is talking about? Found this in our logs yesterday. Made two requests.

216.191.35.225 - - [23/Apr/2001:19:41:28 -0400] "GET /robots.txt HTTP/1.0" 200 1046 "-" "vspider"

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 579 posted 5:54 pm on Apr 24, 2001 (gmt 0)

Well these guys are wide open right now. Have a look:
[216.191.35.225...]
Apparently it is a canned spider/se targeted at business micro portals

From -> [verity.com...]

"Verity was one of the first companies to recognize the value of-and deliver-full-text search solutions for intranet, e-commerce and business portals. Our achievements come from our patented technology, long-term corporate viability, financial strength, support of industry leaders and proven success across a rich, broad customer base....blah,blah,blah..."

Son_House

10+ Year Member



 
Msg#: 579 posted 9:03 am on May 16, 2001 (gmt 0)

Same ua but different ip. Made 2 requests one of which was for robots.txt.

131.84.1.24 - "vspider"
Whois info:

Defense Technical Information Center
8725 John J. Kingman Road
Suite 0944
Fort Belvoir, VA 22060-6218
US

Looks like this is their site: [dtic.mil...]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved