homepage Welcome to WebmasterWorld Guest from 107.20.109.52
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
.htaccess - How many blocked IP before slowness
bumpaw




msg:3562532
 3:30 am on Jan 31, 2008 (gmt 0)

I have a little spider trap that I picked up here at WebmasterWorld and over time the number of IPs listed in the .htaccess file grows. I'm wondering how many can be blocked before the page load takes a noticeable hit?

 

jdMorgan




msg:3563534
 5:19 am on Feb 1, 2008 (gmt 0)

When the server gets slow, that's your answer.

I recommend that you go through the .htaccess lines generated by the script and look for patterns of repeated access from the same IP address ranges -- Sorting the lines by IP address helps to do this.

If you see a large number of IP addresses in the same range getting banned, then delete all of those lines and add a simple mod_access "Deny from" directive that blocks the entire range of addresses. You might block 256 IP addresses at a time, or block an ISP, or even block a whole country -- That is up to you, and depends on your site, its normal visitors, and its abusers. But, for example, I removed several dozen lines of code from my .htaccess file last year, and replaced them all with

Deny from 38.100.0.0/12

You'll need to look up the IP addresses in ARIN, RIPE, APNIC, LACNIC, Afrinic, etc. to find out who/what they are, and how big of a range they are part of. If you're not sure, start small.

Otherwise, you might just want to delete all those lines once a year, or once a month, or whenever the server slows down... :)

Jim

wilderness




msg:3563552
 5:40 am on Feb 1, 2008 (gmt 0)

I removed several dozen lines of code from my .htaccess file last year, and replaced them all with

Deny from 38.100.0.0/12

You'll need to look up the IP addresses in ARIN, RIPE, APNIC, LACNIC, Afrinic, etc. to find out who/what they are, and how big of a range they are part of. If you're not sure, start small.

Otherwise, you might just want to delete all those lines once a year, or once a month, or whenever the server slows down... happy!

Or, if you preferences are in focus you nay simply

Deny from 38. ;)

Don

jdMorgan




msg:3564140
 6:18 pm on Feb 1, 2008 (gmt 0)

Wanted Gigabot, because they 'power' a lot of meta-search engines... :)

Jim

bumpaw




msg:3564366
 10:24 pm on Feb 1, 2008 (gmt 0)

I recommend that you go through the .htaccess lines generated by the script and look for patterns of repeated access from the same IP address ranges -- Sorting the lines by IP address helps to do this.
I have been having the feeling that this needed to be done and now with your advise I will. It seems like the bots and log spammers just keep getting worse.
Thanks

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved