Forum Moderators: open

Message Too Old, No Replies

Observations on MauiBot

         

born2run

11:26 pm on May 18, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Hi so I checked my apache logs and ran a few shell scripts on them.

I noticed this bot MauiBot has been hitting my site and it gives no info in its UA about the intent or website to read their policies.

So I blocked by UA, and now the bot is flooding my site like crazy! So secondly I blocked this ip: 34.204.76.*** does anyone have more ips this bot could be using? It's a complete mess this one imho!

TorontoBoy

12:06 am on May 19, 2018 (gmt 0)

5+ Year Member Top Contributors Of The Month



SetEnvIfNoCase User-Agent MauiBot keep_out

If you banned the UA, you should see error 403s and not 200s. How can it flood your site if you banned it? Also [webmasterworld.com...]

Also, in your robots.txt add:
User-agent: MauiBot
Disallow: /

born2run

12:42 am on May 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Agreed I got irritated and blocked the ip too.. ua ban is enough for now

lucy24

12:48 am on May 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Did you even try
User-Agent: MauiBot
Disallow: /
? I found it to be compliant. As always: the only thing better than a blocked request is a request that is not made in the first place.

TorontoBoy

12:48 am on May 19, 2018 (gmt 0)

5+ Year Member Top Contributors Of The Month



The UA ban should be all you need. This means your UA ban is not working.

keyplyr

1:40 am on May 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Reminder: Code examples/discussion should be done in:

Robots.txt Forum [webmasterworld.com]
and/or
Apache Code Forum [webmasterworld.com]