Welcome to WebmasterWorld Guest from 54.242.63.214

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Fast Crawler

     

Kira

10:26 am on Sep 29, 1999 (gmt 0)

10+ Year Member



Anyone have the ip and User Agent for Fast's alltheweb.com spider?

Brett_Tabke

10:55 am on Sep 30, 1999 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



209.67.247.157 FAST-WebCrawler/0.3 (crawler@fast.no)

littleman

12:55 am on Jul 15, 2000 (gmt 0)

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Name: ix8.fast-search.net - Address: 209.67.247.200
FAST-WebCrawler/2.1-pre7 (crawler@fast.no; [fast.no...]

Also..
Name: ix14.fast-search.net - Address: 209.67.247.206
Name: ix10.fast-search.net - Address: 209.67.247.202
Name: ix9.fast-search.net - Address: 209.67.247.201
Name: ix5.fast-search.net - Address: 209.67.247.157
Name: ix16.fast-search.net - Address: 209.67.247.208
Name: ix12.fast-search.net - Address: 209.67.247.204


Edited by: littleman

redzone

5:33 am on Jul 15, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Littleman,

Approx. 45 days ago we saw many versions of UA's from FAST, over a very short time period.
For IP/UA delivery systems, this was a nightmare....

FAST-WebCrawler/2.1-pre7 (crawler@fast.no; [fast.no...]


We saw pre(5-13) in the UA. Was at that point I was wishing our system design parsed host and IP, rather than UA and IP... :)

 

Featured Threads

Hot Threads This Week

Hot Threads This Month