I've got an RSS feed that only needs updating maybe every six months, tops. Thing is, some readers insist on hitting the file every four hours, 24/7. And last weekend, one started hitting it approx. every 10 minutes:
I wouldnt deny traffic through iptables because you never know what users you are blocking in the future.
Why not monitor the traffic generated by the RSS feed? If it is too low just stop serving the RSS feed and serve a 404. Or you could move the RSS feed to a low budget VPS and serving a 301 redirect on the current RSS feed.
- I reserve iptables for cesspool server farm CIDRs and the worst-of-the-worst individual IPs. Hitting a very infrequently-updated file every 10 minutes ad nauseam qualifies as the latter vis-a-vis our small, private server.
- The traffic to those subscribers that use respectful apps is fine, and appreciated on both sides so there's no need to stop it... but for the abusers.
- Alas, axing or removing or moving the feed doesn't stop the abusive hits that are already going on. And 404s, or 301s, like 403s, only add to server processes and log bloat.
I guess I'm simply hoping for some way to throttle non-conforming apps via the RSS file. Got a magic element, a way to make them mind? Because even an htaccess/mod_rewrite rule limiting access to the file based on time of day doesn't prevent the endless, mindless, useless hits the rest of the time.