homepage Welcome to WebmasterWorld Guest from 54.145.183.169
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
av?
roscoepico

10+ Year Member



 
Msg#: 112 posted 9:33 pm on Aug 24, 2000 (gmt 0)

IP: 128.177.243.207
UA: Scooter/1.0
This traces back to a guy named Paul Vixie...any ideas???

 

Air

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 112 posted 12:44 am on Aug 25, 2000 (gmt 0)

Definitely Alta Vista;

Reverse Lookup Result: add-url2.sv.alta-vista.net

Lookup Result: 128.177.243.207

Domain registry query for:alta-vista.net:

Whois Server Version 1.1

Domain names in the .com, .net, and .org domains can now be registered
with many different competing registrars. Go to [internic.net...]
for detailed information.

Domain Name: ALTA-VISTA.NET
Registrar: NETWORK SOLUTIONS, INC.
Whois Server: whois.networksolutions.com
Referral URL: www.networksolutions.com
Name Server: NS2.ALTAVISTA.COM
Name Server: NS1.ALTAVISTA.COM
Name Server: NS3.ALTAVISTA.COM
Updated Date: 17-feb-2000

roscoepico

10+ Year Member



 
Msg#: 112 posted 3:46 am on Aug 25, 2000 (gmt 0)

this is what it brought up @ arin...

10 Cathy Place
Menlo Park, CA 94025
US

Netname: BLNC-BLK
Netblock: 128.177.0.0 - 128.177.255.255

Coordinator:
Vixie, Paul (PV15-ARIN) paul@VIX.COM
+1 415 747 0204

Domain System inverse mapping provided by:

NS-EXT.VIX.COM204.152.184.64
NS1.GNAC.COM209.182.195.77

Record last updated on 01-Jun-1999.
Database last updated on 24-Aug-2000 17:56:57 EDT.

Kamikaze

10+ Year Member



 
Msg#: 112 posted 7:06 pm on Aug 25, 2000 (gmt 0)

Great catch roscoepico! So did they crawl through your site? How did you catch them? Did they go through the robots.txt file?

Air

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 112 posted 9:14 pm on Aug 25, 2000 (gmt 0)

Yeah, I see your point and it does make you think, doesn't it? Why couldn't it be fake?

The reason I thought it authentic is that on a traceroute the last hop before hitting the a-v.net domain is mibh.net,
so given that, there just seemed to be too many things that pointed to an authentic AV spider. Plus Paul Vixie is known to be associated with mibh and they are known to spider on behalf of AV.

I wasen't being smug. I hope it didn't come across that way.

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 112 posted 10:11 pm on Aug 25, 2000 (gmt 0)

Check out www.alta-vista.net [alta-vista.net]. It is a fully functional face to AV. The searches are directed internally [alta-vista.net].

redzone

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 112 posted 7:31 am on Aug 26, 2000 (gmt 0)

Paul Vixie, alias (mibh.net), is/are supposedly the third party group that is responsible for AV's anti-spam campaign.. They were crawling last winter w/ variable user agents, sometimes even as a "Perl" script.......

But the Class "C" -> 128.177.243 is the dead give away.... Many thought they were comparing page stats to the actual AV crawl of the URL.. We've been showing both the identical content for some time now....

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved