Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

Internet Archive and Thunderstone? Who are they

5:03 pm on Apr 16, 2001 (gmt 0)

New User

10+ Year Member

joined:Apr 5, 2001
votes: 0

I just analyzed my log files with NetTracker Pro 4.0, and the following two appeared in my robot/spider section, though I don't know who they are: Thunderstone (IP: and Internet Archive (uses several ips: 209.247.40. 105-109 and 165-174. Thanks a lot for any help in advance. Also, does anyone know how I change Googlebot to show up in the robot section and not hosts? Thanks a lot
5:09 pm on Apr 16, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
votes: 12

It sounds like that is the software being using by Metacrawler.
There are a couple of posts in this forum about it.

(sorry justin, we don't allow sig file urls here - drop it on your profile).

btw: welcome to the forums. Nice to see another new user who knows how to read log files drop in.