Welcome to WebmasterWorld Guest from 3.231.229.89

Forum Moderators: Ocean10000 & phranque

Message Too Old, No Replies

.htaccess - How many blocked IP before slowness

     
3:30 am on Jan 31, 2008 (gmt 0)

Preferred Member

10+ Year Member

joined:Jan 19, 2004
posts: 562
votes: 0


I have a little spider trap that I picked up here at WebmasterWorld and over time the number of IPs listed in the .htaccess file grows. I'm wondering how many can be blocked before the page load takes a noticeable hit?
5:19 am on Feb 1, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


When the server gets slow, that's your answer.

I recommend that you go through the .htaccess lines generated by the script and look for patterns of repeated access from the same IP address ranges -- Sorting the lines by IP address helps to do this.

If you see a large number of IP addresses in the same range getting banned, then delete all of those lines and add a simple mod_access "Deny from" directive that blocks the entire range of addresses. You might block 256 IP addresses at a time, or block an ISP, or even block a whole country -- That is up to you, and depends on your site, its normal visitors, and its abusers. But, for example, I removed several dozen lines of code from my .htaccess file last year, and replaced them all with


Deny from 38.100.0.0/12

You'll need to look up the IP addresses in ARIN, RIPE, APNIC, LACNIC, Afrinic, etc. to find out who/what they are, and how big of a range they are part of. If you're not sure, start small.

Otherwise, you might just want to delete all those lines once a year, or once a month, or whenever the server slows down... :)

Jim

5:40 am on Feb 1, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5507
votes: 5


I removed several dozen lines of code from my .htaccess file last year, and replaced them all with

Deny from 38.100.0.0/12

You'll need to look up the IP addresses in ARIN, RIPE, APNIC, LACNIC, Afrinic, etc. to find out who/what they are, and how big of a range they are part of. If you're not sure, start small.

Otherwise, you might just want to delete all those lines once a year, or once a month, or whenever the server slows down... happy!

Or, if you preferences are in focus you nay simply

Deny from 38. ;)

Don

6:18 pm on Feb 1, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


Wanted Gigabot, because they 'power' a lot of meta-search engines... :)

Jim

10:24 pm on Feb 1, 2008 (gmt 0)

Preferred Member

10+ Year Member

joined:Jan 19, 2004
posts: 562
votes: 0


I recommend that you go through the .htaccess lines generated by the script and look for patterns of repeated access from the same IP address ranges -- Sorting the lines by IP address helps to do this.
I have been having the feeling that this needed to be done and now with your advise I will. It seems like the bots and log spammers just keep getting worse.
Thanks
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members