Forum Moderators: open

Message Too Old, No Replies

antiquated robots

         

lucy24

12:38 am on Feb 5, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've been doing some housecleaning in User-Agent lists, and would like to double-check a few names.

Last Seen in 2013:
FairShare (March 2013)
kalooga (KaloogaBot, April 2013)
WebReaper (May 2013)
\.exe\b (i.e. any user-agent with word ending .exe: September 2013)
webcollage (November 2013)
web/snippet (November 2013)

Has anyone set eyes on any of these in the past year? In the specific case of WebReaper I've only ever seen them once-- but their behavior was so egregious that if the utility still exists, I'll continue blocking them.

The string "web/snippet" refers to Google's snippetbot
Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google (+https://developers.google.com/+/web/snippet/)

If it no longer exists, there's no point in continuing to block it.

Last Seen in 2012:
NativeHost (March 2012)
CoverScout (Dec 2012)

Last Seen in 2011:
vcbot (July 2011)
Covario (September 2011)
Extreme Picture Finder (October 2011)

unknown:
Wikimpress

I don't know what they did to offend me or when they did it, because I can find absolutely no record of the name. I don't generally block unknowns on the basis of WebmasterWorld threads alone [webmasterworld.com].

trintragula

9:21 am on Feb 5, 2015 (gmt 0)

10+ Year Member Top Contributors Of The Month



I don't believe I've seen any of these, except web/snippet, which I still see regularly. Sometimes from google's proxies, but more often from DSL and other apparently innocuous locations. Web/snippet has not been troublesome. It's been by as recently as November 2014.
Oh and a couple of things with .exe in the name, but not in the last year.

aristotle

10:24 pm on Feb 5, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Here's one that I've been seeing lately:
Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http:// www.changedetection.com/bot)

A web search revealed that it's been around at least since 2003, when it was discussed here on WebmasterWorld:
[webmasterworld.com ]
That thread also dsicusses a lot of other old bots from that era.