So this bot ccbot I've blocked using ua but I want to block all their ip addresses. They keep changing ips and are spidering old content which is not even present in my site.
Anyone know their ip ranges? Thanks!
lucy24
5:51 pm on Apr 26, 2018 (gmt 0)
First things first: It isn’t “ccbot”, it’s “CCBot”. Keep things case-sensitive unless you’ve got an overpowering reason not to.
In the past year, I find CCBot from a wide array of IPs in the 54 sector, from 54.80 on up. If you choose to block all known AWS ranges, that is entirely your decision. Personally I’ve got them on my Ignore list after deeming them to be robots.txt compliant, which I must have done years ago. Have they been ignoring your Disallows?
:: wandering off to investigate unnerving discovery that robot I've allowed-and-ignored for years (not CCBot) has habitually been requesting files in a disallowed directory ::
keyplyr
7:27 pm on Apr 26, 2018 (gmt 0)
@born2run - CCBot is distributed. There is not a specific range(s) you can block.
