Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Internet Archive and Thunderstone? Who are they



5:03 pm on Apr 16, 2001 (gmt 0)

10+ Year Member

I just analyzed my log files with NetTracker Pro 4.0, and the following two appeared in my robot/spider section, though I don't know who they are: Thunderstone (IP: and Internet Archive (uses several ips: 209.247.40. 105-109 and 165-174. Thanks a lot for any help in advance. Also, does anyone know how I change Googlebot to show up in the robot section and not hosts? Thanks a lot


5:09 pm on Apr 16, 2001 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

It sounds like that is the software being using by Metacrawler.
There are a couple of posts in this forum about it.

(sorry justin, we don't allow sig file urls here - drop it on your profile).

btw: welcome to the forums. Nice to see another new user who knows how to read log files drop in.


Featured Threads

Hot Threads This Week

Hot Threads This Month