Forum Moderators: open

Message Too Old, No Replies

MixrankBot

MixrankBot

         

WebOpz

1:00 pm on Jun 3, 2021 (gmt 0)

5+ Year Member Top Contributors Of The Month



Anyone got some deeper insights into MixrankBot?

66.231.185.74
Mozilla/5.0 (compatible; MixrankBot; crawler@-mixrank[.]com

Didn't seem to respect robots.txt at all.

Website says it's a 'Business Data Platform' Track your target accounts, their vendors, tech installs, and decision makers.

I'm gonna block for now but would appreciate if anyone has any interaction or experience with them....

lucy24

4:27 pm on Jun 3, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



:: detour to logs, followed by further detour to headers ::

Huh. I've flagged them as bad_agent, which I don't usually bother to do with someone who only makes one request every few months--I find a total of 8 requests in the past year and a half--all for the root / of my personal site.

:: further detour to older logs ::

Nope, it's not because at some past date they committed a major offense. Maybe they just happened to come in at the very beginning or very end of a day's log file, so they caught my notice.

Didn't seem to respect robots.txt at all.
Where “didn’t respect” means “didn’t seem to be aware such a file existed”?