209.67.247.232 user agent Mozilla/4.0 (compatible; MSIE 4.01

snagged by IP ( i think)

[han solo]

Traced this one back to Fast, and it seems that they've had this c class since march 99, but I hadn't seen it until yesterday.

The weird thing is that it went through nearly all of my domains...in about an hour. Anybody else have this happen to them?

This is the first time I've been hit by them with a non standard user agent, would anyone like to share a similar story? Thanks,

Han Solo

[msgraph]

You are not alone Han, found the little guy snooping around on about 25 of my sites yesterday. All within a 30 minute period grabbing the root index page.

Caught him by the same IP 209.67.247.232.

They did the same thing back in Nov. last year on the same server.

[webmasterworld.com...]

[Rumbas]

I know for sure that [Jubii.dk...] just started using FAST for international [verden.jubii.dk]searches. This is the latest development in the Jubii/Spray and Lycos Europe.

Just a huch..

Added:

Oleon tells [webmasterworld.com] that Web.de started using FAST as their international search provider - beating Altavista.de

A need for FAsTer indexing?

:)

[han solo]

Ah ha, missed the boat last time. Maybe my work isn't special enough to get snooped in the first round? :(

If I only had some skills...

Cheers,

Han Solo

Thanks for pointing me to the other thread. Good to know others have seen it, too. Now if we only knew why...

[borud]

The spider you have observed is used for analyzing
certain aspects if websites in order to make
crawling more efficient and to better represent
your sites in the index. If you have any questions I'll try my best to answer them
in email (I do not check this forum regularly
since I have a rather busy schedule).

(Yes, I wrote the spider, and the reason it
"misrepresents" itself as a Mozilla compatible browser is because a lot of websites will give out meaningless information if they do not recognize
the user-agent. It is used for limited crawling
only and I have gone to some length to make it as friendly on the sites it visits as possible)

Please remember that I might not be able to answer all your questions directly, and I certainly can understand if you find this frustrating, but this is the way it needs to be since I work for a
commercial entity and my first and foremost priority is to create the best service possible for you, our users.

Please feel free to drop me a note at [e-mail] if you want to ask me something.

-Bjørn

[jeremy goodrich]

Thank you kindly.

I sincerely appreciate the offer of help in answering questions, and I believe that many here do so as well.

I think I will take you up on the offer of emailing you.

Jeremy, formerly known as Han Solo

(so you know)