Welcome to WebmasterWorld Guest from 54.159.50.111

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Internet Archive and Thunderstone? Who are they

     
5:03 pm on Apr 16, 2001 (gmt 0)

New User

10+ Year Member

joined:Apr 5, 2001
posts:32
votes: 0


I just analyzed my log files with NetTracker Pro 4.0, and the following two appeared in my robot/spider section, though I don't know who they are: Thunderstone (IP:63.251.4.43) and Internet Archive (uses several ips: 209.247.40. 105-109 and 165-174. Thanks a lot for any help in advance. Also, does anyone know how I change Googlebot to show up in the robot section and not hosts? Thanks a lot
Justin
5:09 pm on Apr 16, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38048
votes: 12


It sounds like that is the software being using by Metacrawler.
There are a couple of posts in this forum about it.

(sorry justin, we don't allow sig file urls here - drop it on your profile).

btw: welcome to the forums. Nice to see another new user who knows how to read log files drop in.