Welcome to WebmasterWorld Guest from 107.20.54.98

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Fast Crawler

     
10:26 am on Sep 29, 1999 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 25, 2002
posts:98
votes: 0


Anyone have the ip and User Agent for Fast's alltheweb.com spider?
10:55 am on Sept 30, 1999 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38047
votes: 11


209.67.247.157 FAST-WebCrawler/0.3 (crawler@fast.no)
12:55 am on July 15, 2000 (gmt 0)

Senior Member

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 17, 2000
posts:2924
votes: 0


Name: ix8.fast-search.net - Address: 209.67.247.200
FAST-WebCrawler/2.1-pre7 (crawler@fast.no; [fast.no...]

Also..
Name: ix14.fast-search.net - Address: 209.67.247.206
Name: ix10.fast-search.net - Address: 209.67.247.202
Name: ix9.fast-search.net - Address: 209.67.247.201
Name: ix5.fast-search.net - Address: 209.67.247.157
Name: ix16.fast-search.net - Address: 209.67.247.208
Name: ix12.fast-search.net - Address: 209.67.247.204


Edited by: littleman

5:33 am on July 15, 2000 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 8, 2000
posts:684
votes: 0


Littleman,

Approx. 45 days ago we saw many versions of UA's from FAST, over a very short time period.
For IP/UA delivery systems, this was a nightmare....

FAST-WebCrawler/2.1-pre7 (crawler@fast.no; [fast.no...]


We saw pre(5-13) in the UA. Was at that point I was wishing our system design parsed host and IP, rather than UA and IP... :)