homepage Welcome to WebmasterWorld Guest from 54.198.46.115
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
After "Korean research" mission completed...
Is this AV? I doubt it...
Kamikaze




msg:404248
 3:50 pm on Jun 23, 2000 (gmt 0)

IP: 216.250.137.3
User Agent: AVSearch-3.0(AltaVista/AVC)

And it grabbed my Robots.txt file.
Wise guys or is it really them?

Edited by: Kamikaze

 

fantomaster




msg:404249
 2:28 am on Jun 24, 2000 (gmt 0)

The UserAgent AVSearch-3.0 belongs to:

AltaVista Search Engine 3.0

This is the search engine AltaVista is selling mainly as a business product for usage in corporate intranets.

We tried out the evaluation version ourselves.
You can spider web sites and index file systems with this engine.

The IP 216.250.137.3 will not resolve properly.
There is no indication that this IP range is connected to any established search engines.

We have categorized this spider as a DC (Decloaking Hazard).

This means that if you are cloaking your site you
should not feed this spider with any cloaked or phantom pages!

Edited by: fantomaster

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved