homepage Welcome to WebmasterWorld Guest from 184.72.69.79
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Fast Crawler
Kira




msg:401556
 10:26 am on Sep 29, 1999 (gmt 0)

Anyone have the ip and User Agent for Fast's alltheweb.com spider?

 

Brett_Tabke




msg:401557
 10:55 am on Sep 30, 1999 (gmt 0)

209.67.247.157 FAST-WebCrawler/0.3 (crawler@fast.no)

littleman




msg:401558
 12:55 am on Jul 15, 2000 (gmt 0)

Name: ix8.fast-search.net - Address: 209.67.247.200
FAST-WebCrawler/2.1-pre7 (crawler@fast.no; [fast.no...]

Also..
Name: ix14.fast-search.net - Address: 209.67.247.206
Name: ix10.fast-search.net - Address: 209.67.247.202
Name: ix9.fast-search.net - Address: 209.67.247.201
Name: ix5.fast-search.net - Address: 209.67.247.157
Name: ix16.fast-search.net - Address: 209.67.247.208
Name: ix12.fast-search.net - Address: 209.67.247.204


Edited by: littleman

redzone




msg:401559
 5:33 am on Jul 15, 2000 (gmt 0)

Littleman,

Approx. 45 days ago we saw many versions of UA's from FAST, over a very short time period.
For IP/UA delivery systems, this was a nightmare....

FAST-WebCrawler/2.1-pre7 (crawler@fast.no; [fast.no...]


We saw pre(5-13) in the UA. Was at that point I was wishing our system design parsed host and IP, rather than UA and IP... :)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved