Welcome to WebmasterWorld Guest from 54.146.240.181

Forum Moderators: Ocean10000 & incrediBILL & phranque

Message Too Old, No Replies

.htaccess - How many blocked IP before slowness

     

bumpaw

3:30 am on Jan 31, 2008 (gmt 0)

10+ Year Member



I have a little spider trap that I picked up here at WebmasterWorld and over time the number of IPs listed in the .htaccess file grows. I'm wondering how many can be blocked before the page load takes a noticeable hit?

jdMorgan

5:19 am on Feb 1, 2008 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



When the server gets slow, that's your answer.

I recommend that you go through the .htaccess lines generated by the script and look for patterns of repeated access from the same IP address ranges -- Sorting the lines by IP address helps to do this.

If you see a large number of IP addresses in the same range getting banned, then delete all of those lines and add a simple mod_access "Deny from" directive that blocks the entire range of addresses. You might block 256 IP addresses at a time, or block an ISP, or even block a whole country -- That is up to you, and depends on your site, its normal visitors, and its abusers. But, for example, I removed several dozen lines of code from my .htaccess file last year, and replaced them all with


Deny from 38.100.0.0/12

You'll need to look up the IP addresses in ARIN, RIPE, APNIC, LACNIC, Afrinic, etc. to find out who/what they are, and how big of a range they are part of. If you're not sure, start small.

Otherwise, you might just want to delete all those lines once a year, or once a month, or whenever the server slows down... :)

Jim

wilderness

5:40 am on Feb 1, 2008 (gmt 0)

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



I removed several dozen lines of code from my .htaccess file last year, and replaced them all with

Deny from 38.100.0.0/12

You'll need to look up the IP addresses in ARIN, RIPE, APNIC, LACNIC, Afrinic, etc. to find out who/what they are, and how big of a range they are part of. If you're not sure, start small.

Otherwise, you might just want to delete all those lines once a year, or once a month, or whenever the server slows down... happy!

Or, if you preferences are in focus you nay simply

Deny from 38. ;)

Don

jdMorgan

6:18 pm on Feb 1, 2008 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Wanted Gigabot, because they 'power' a lot of meta-search engines... :)

Jim

bumpaw

10:24 pm on Feb 1, 2008 (gmt 0)

10+ Year Member



I recommend that you go through the .htaccess lines generated by the script and look for patterns of repeated access from the same IP address ranges -- Sorting the lines by IP address helps to do this.
I have been having the feeling that this needed to be done and now with your advise I will. It seems like the bots and log spammers just keep getting worse.
Thanks
 

Featured Threads

Hot Threads This Week

Hot Threads This Month