Babbar's

Barkrowler bot

[blend27]

Fairly new on my sites from babbar.tech/crawler --- SEO Purposes bot(PageRank is dead ! Find out why on Avril 1st of 2002)

Mozilla/5.0+(compatible;+Barkrowler/0.9;++https://babbar.tech/crawler)

Robots.txt - Yes

Took root page plus another page and left.

Claims to crawl from multiple IP Ranges.

AS210743 contains 2 for now.
217.113.194.0/24
154.54.249.0/24

RDNS contains .babbar.eu

PageRank is dead ! Find out why.

[lucy24]

Heh. I’ve been seeing Barkrowler for so long, they’re on my Ignore list--meaning that when I process logs, they’re left out, just like major search engines and other routine crawlers. I see them from 154 far more often than 217.

Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)

(to distinguish between actual + signs and the ones that are an artifact of space-conversion).
:: detour to At Home page ::
They used to be 0.7 and moved up to 0.9 in mid-2019, both with a UA string referencing exensa.com. The version with babbar.tech showed up at the beginning of 2020 after a multi-month absence. That's assuming it is all the same robot.

[blend27]

++ nice catch, i grabbed it from a raw file and headed straight here to report :)

[Sgt_Kickaxe]

Several private companies that offer site protection have bots that mimic other bots crawling all over the net looking for weaknesses. Fear sells.

When you ban a crawler, you're just trying to block the crawler, not stop an attack, right?

[tangor]

Any bot that does not respect my robots.txt directives IS considered an "attacker". I don't mind 403s in the log.

[blend27]

--- bots that mimic other bots crawling all over---

That is in The name of the game, it is a given....