new IP range for Fast spider

Forum Moderators: open

Message Too Old, No Replies

new IP range for Fast spider

PeteU

2:20 am on Jan 19, 2002 (gmt 0)

66.77.73.xxx just showed up about an hour ago...

wilderness

6:26 am on Jan 19, 2002 (gmt 0)

here is some interesting Fast

66.77.74.222 - - [18/Jan/2002:01:14:37 -0800] "GET / HTTP/1.0" 403 - "-" "libwww-perl/5.52 FP/4.0"
66.77.74.162 - - [18/Jan/2002:01:47:59 -0800] "GET HTTP/1.0" 403 - "-" "FAST-WebCrawler/3.3 (crawler@fast.no; [fast.no...]

makemetop

11:15 am on Jan 19, 2002 (gmt 0)

Latest FAST IPs include User Agent: FAST-WebCrawler/3.3 IP Address: 66.77.74.185

Hmmm!

wilderness

3:13 pm on Jan 19, 2002 (gmt 0)

My only reason for denying access to Fast was the use of libwww-perl/5.52 FP/4.0.

IMO that UA is not a clear definition of use or intent of the bot. Nor does it provide a URL for source.
IMO not a very wise thing for reputable search engine to invoke.

I have denied both
66.77.73.
66.77.74.

This bot very persistent and aware :-)
I had about 20 deny-attempts yesterday.
After my submission here last night there are amany many more.