Welcome to WebmasterWorld Guest from 54.167.58.159

Forum Moderators: bakedjake

Message Too Old, No Replies

ExactSeek redux

     

lucy24

11:13 pm on Aug 24, 2013 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



Can anyone shed any light on ExactSeek? Forums search doesn't turn up anything more recent than 2008; most discussion is much earlier (thread numbers in the lower 4 digits, meaning 2003 or so). I get the impression they're a pay-for-inclusion, by-request-only search engine... but if so, what's their robot doing on my site? I've definitely never had any interaction with them, but they've been crawling sporadically for months, with a previous spurt of activity last year. (Do they take the winter off? Where do they go?)

Viewed purely as a robot they're perfectly well behaved: always ask for robots.txt and appear to obey it. ("Appear to" = none of my roboted-out directories are directly linked from the front page, and they never go beyond the first link, except for one directory that for some reason seems to interest them.)

What do they want, and will it do any harm to let them have it?

mack

4:26 am on Aug 31, 2013 (gmt 0)

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



There's a blast from the past. If I remember rightly it used to be a PFI search engine, but I think they used a third party search provider for when they didnít have sponsored listings. Thats going way back, and TBO I havenít heard very much at all from them lately.

I had a look at their site and their results all show the Alexa logo next to them. I wonder if the Exactseek UA is being used by Alexa?

Mack.

lucy24

7:57 am on Aug 31, 2013 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



:: detour to check IP ::

74.63.43.213
ExactSeek Crawler (nutch 1.4)/Nutch-1.4 (ExactSeek Crawler; http:/ /www.exactseek.com)

:: go back a year (oldest readily accessible logs) ::

identical IP, but back then it was only
ExactSeek Crawler (nutch 1.4)/Nutch-1.4

:: insert boilerplate about how I don't remember why I don't have a generic block on "Nutch", but I kinda think there was a reason* ::

Free lookup says
74.63.32.0/19
is exactseek. (But who is Voxel dot net?)


* In the same way that you will not remember what that mysterious, vaguely-nut-like doodad in the back of your junk drawer was for ... until a week after you say To hell with it and throw it away.

mack

1:46 pm on Aug 31, 2013 (gmt 0)

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



I don't see it as being legit..Nutch is an opensource crawler search engine, but for a web search engine I falls short. May be a data miner using the Exactseek UA.

Mack.