SiteSucker/1.4.2

Another one?

[pendanticist]

24.168.68.13 - - [04/Nov/2003:05:31:59 -0800] "HEAD / HTTP/1.1" 200 0 "http*//Referer_Not_Relevant_to_Question" "[b]SiteSucker/1.4.2[/b]"

I searched all over the newsgroups and such, finding absolutely nothing on this puppy.

Looks like an addition to WebmasterWorld forum11 Updated and Collated Bot List Deprecated - Search Engine Spider Identification [webmasterworld.com], but that forum is closed [webmasterworld.com] now.

<How you gonna update, bull?>

Anyway, this critter falls into that category of "I just don't like the name" [webmasterworld.com].

I'm guessing a suitable...

RewriteCond %{HTTP_USER_AGENT} SiteSucker [NC,OR]

...would be the way to go?

Pendanticist.

[bcolflesh]

Did you see this?:

sitesucker.us/

[pendanticist]

Just what's there is all that was in my logs. Just that one instance.

Pendanticist.

[bcolflesh]

Sorry - I meant that the site above is probably the one related to that UA - as you suspected, it's a grabber.

[pendanticist]

Oh, <chuckle> the one I blotted out. No, that url is a trusted referrer of mine who has had my link up four, mebe five years now.

:)

Pendanticist.

[bcolflesh]

Hehe - I meant that the UA - SiteSucker - is probably from the piece of software described here:

sitesucker.us/

[pendanticist]

<I'm awake, really I am....>

Yep, that sounds like the one. Odd how it's been out so long and just now I'm seeing it.

Pendanticist.

[amznVibe]

This was a good find. Probably should be noted/linked to in A Close to perfect .htaccess ban list - Part 3 [webmasterworld.com]

It probably obeys robots.txt because no one has noticed it before?