1. Home
  2. Forums Index
  3. Server Side / Apache Web Server 3:20 am May 2, 2026

Forum Moderators: phranque

Message Too Old, No Replies

Condensing htaccess file

         

kmonroe

3:46 pm on Jul 22, 2010 (gmt 0)

10+ Year Member



How can I condense this htaccess file? 

Order Allow,Deny
##-##
Allow from all

Redirect 301 /music/canakkale.mp3 http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.8/scripts/setup.php http://www.domain101.com/
Redirect 301 /PMA/scripts/setup.php http://www.domain101.com/
Redirect 301 /PMA2005/scripts/setup.php http://www.domain101.com/
Redirect 301 /admin/mysql/scripts/setup.php http://www.domain101.com/
Redirect 301 /admin/phpmyadmin/scripts/setup.php http://www.domain101.com/
Redirect 301 /noxdir/nosuichfile.php http://www.domain101.com/
Redirect 301 /nosuichfile.php http://www.domain101.com/
Redirect 301 /admin/scripts/setup.php http://www.domain101.com/
Redirect 301 /mysqlmanager/scripts/setup.php http://www.domain101.com/
Redirect 301 /p/m/a/scripts/setup.php http://www.domain101.com/
Redirect 301 /myadmin/scripts/setup.php http://www.domain101.com/
Redirect 301 /dbadmin/scripts/setup.php http://www.domain101.com/
Redirect 301 /mysql/scripts/setup.php http://www.domain101.com/
Redirect 301 /db/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.10.0/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.0/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.5.4/scripts/setup.php http://www.domain101.com/
Redirect 301 /admin/pma/scripts/setup.php http://www.domain101.com/
Redirect 301 /mysqladmin/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyA/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.5/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.6/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.2/scripts/setup.php http://www.domain101.com/
Redirect 301 /php-my-admin/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.0/scripts/setup.php http://www.domain101.com/
Redirect 301 /php-myadmin/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.2.6/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.8/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.7/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.9/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.5/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.7/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.6/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.8/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.5.0/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.5.2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.4.9/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.5.1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.5.5-pl1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.3-pl1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.4-pl3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.3-rc1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.4-pl2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.4-pl1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.4-pl4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.7/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.0-beta1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.0-pl1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.5/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.6/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.4-rc1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.9/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.5/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.0-pl2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.6/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.0/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.7/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.0-rc1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.0-rc2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.0.2/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.8/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.0-rc1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.0.1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.7.9/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.0-beta1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.0.3/scripts/setup.php http://www.domain101.com/
Redirect 301 /webadmin/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpmyad-sys/scripts/setup.php http://www.domain101.com/
Redirect 301 /mysql-admin/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmi/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.10/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.6/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.7/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.9/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.11.8/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.2.3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.3.5/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.5.5-rc1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.0-beta/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.5.7/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.0-alpha/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.0-rc3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.0/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.6.2-beta1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8./scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.0/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.5/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.9./scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-2.8.4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAds/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-4/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-3/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin-/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpMyAdmin1/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpm/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpmanager/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpmy-admin/scripts/setup.php http://www.domain101.com/
Redirect 301 /phpmyad/scripts/setup.php http://www.domain101.com/

<Files .htaccess>
order allow,deny
deny from all
</Files>

<Files .htpasswd>
order allow,deny
deny from all
</Files>

ErrorDocument 400 /errorpage.php
ErrorDocument 401 /errorpage.php
ErrorDocument 403 /errorpage.php
ErrorDocument 404 /errorpage.php
ErrorDocument 500 /errorpage.php


Options +FollowSymLinks
RewriteEngine on
RewriteBase /


# index.php to /
RewriteCond %{THE_REQUEST} ^[A-Z]{3,9}\ /.*index\.php\ HTTP/
RewriteRule ^(.*)index\.php$ /$1 [R=301,L]




RewriteCond %{HTTP_USER_AGENT} android|avantgo|blackberry|blazer|compal|elaine|fennec|hiptop|ip(hone|od)|iris|kindle|lge\ |maemo|midp|mmp|mobile|o2|opera\ mini|palm(\ os)?|plucker|pocket|pre\/|psp|smartphone|symbian|treo|up\.(browser|link)|vodafone|wap|windows\ ce;\ (iemobile|ppc)|xiino [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^(1207|6310|6590|3gso|4thp|50[1-6]i|770s|802s|a\ wa|abac|ac(er|oo|s\-)|ai(ko|rn)|al(av|ca|co)|amoi|an(ex|ny|yw)|aptu|ar(ch|go)|as(te|us)|attw|au(di|\-m|r\ |s\ )|avan|be(ck|ll|nq)|bi(lb|rd)|bl(ac|az)|br(e|v)w|bumb|bw\-(n|u)|c55\/|capi|ccwa|cdm\-|cell|chtm|cldc|cmd\-|co(mp|nd)|craw|da(it|ll|ng)|dbte|dc\-s|devi|dica|dmob|do(c|p)o|ds(12|\-d)|el(49|ai)|em(l2|ul)|er(ic|k0)|esl8|ez([4-7]0|os|wa|ze)|fetc|fly(\-|_)|g1\ u|g560|gene|gf\-5|g\-mo|go(\.w|od)|gr(ad|un)|haie|hcit|hd\-(m|p|t)|hei\-|hi(pt|ta)|hp(\ i|ip)|hs\-c|ht(c(\-|\ |_|a|g|p|s|t)|tp)|hu(aw|tc)|i\-(20|go|ma)|i230|iac(\ |\-|\/)|ibro|idea|ig01|ikom|im1k|inno|ipaq|iris|ja(t|v)a|jbro|jemu|jigs|kddi|keji|kgt(\ |\/)|klon|kpt\ |kwc\-|kyo(c|k)|le(no|xi)|lg(\ g|\/(k|l|u)|50|54|e\-|e\/|\-[a-w])|libw|lynx|m1\-w|m3ga|m50\/|ma(te|ui|xo)|mc(01|21|ca)|m\-cr|me(di|rc|ri)|mi(o8|oa|ts)|mmef|mo(01|02|bi|de|do|t(\-|\ |o|v)|zz)|mt(50|p1|v\ )|mwbp|mywa|n10[0-2]|n20[2-3]|n30(0|2)|n50(0|2|5)|n7(0(0|1)|10)|ne((c|m)\-|on|tf|wf|wg|wt)|nok(6|i)|nzph|o2im|op(ti|wv)|oran|owg1|p800|pan(a|d|t)|pdxg|pg(13|\-([1-8]|c))|phil|pire|pl(ay|uc)|pn\-2|po(ck|rt|se)|prox|psio|pt\-g|qa\-a|qc(07|12|21|32|60|\-[2-7]|i\-)|qtek|r380|r600|raks|rim9|ro(ve|zo)|s55\/|sa(ge|ma|mm|ms|ny|va)|sc(01|h\-|oo|p\-)|sdk\/|se(c(\-|0|1)|47|mc|nd|ri)|sgh\-|shar|sie(\-|m)|sk\-0|sl(45|id)|sm(al|ar|b3|it|t5)|so(ft|ny)|sp(01|h\-|v\-|v\ )|sy(01|mb)|t2(18|50)|t6(00|10|18)|ta(gt|lk)|tcl\-|tdg\-|tel(i|m)|tim\-|t\-mo|to(pl|sh)|ts(70|m\-|m3|m5)|tx\-9|up(\.b|g1|si)|utst|v400|v750|veri|vi(rg|te)|vk(40|5[0-3]|\-v)|vm40|voda|vulc|vx(52|53|60|61|70|80|81|83|85|98)|w3c(\-|\ )|webc|whit|wi(g\ |nc|nw)|wmlb|wonu|x700|xda(\-|2|g)|yas\-|your|zeto|zte\-) [NC]
RewriteRule ^$ http://www.domain101.com/mobile [R,L]

# this ruleset is to "stop" stupid attempts to use MS IIS expolits on us
# NIMDA
RewriteCond %{REQUEST_URI} /(cmd¦root¦shell)\.exe$[NC,OR]
RewriteCond %{REQUEST_URI} /(admin¦httpodbc)\.dll$[NC]
RewriteRule .* /cgi-bin/nonimda.cmd [L,E=HTTP_USER_AGENT:NIMDA_EXPLOIT,T=application/x-httpd-cgi]

# CODERED
RewriteCond %{REQUEST_URI} /default\.(ida¦idq)$[NC,OR]
RewriteCond %{REQUEST_URI} /.*\.printer$[NC]
RewriteRule .* /cgi-bin/nocode-r.cmd [L,E=HTTP_USER_AGENT:CODERED_EXPLOIT,T=application/x-httpd-cgi]

# this ruleset is for formmail script abusers...
RewriteCond %{REQUEST_URI} formmail\.(pl¦cgi)$[NC,OR]
RewriteCond %{REQUEST_URI} mailto\.(exe¦cgi)$[NC]
RewriteRule .* /cgi-bin/nofrmml.cmd [L,E=HTTP_USER_AGENT:FORMMAIL_EXPLOIT,T=application/x-httpd-cgi]

# Cyveillance is a spybot that scours the web for copyright violations and “damaging information” on
# behalf of clients such as the RIAA and MPAA. Their robot spoofs its User-Agent to look like Internet
# Explorer, and it completely ignores robots.txt. I have
# banned it by IP address.
RewriteCond %{REMOTE_ADDR} "^63\.148\.99\.2(2[4-9]¦[3-4][0-9]¦5[0-5])$"
RewriteRule .* - [F]

# There is another email harvester which always claims to be referred from http://www.iaea.org/.
# You may have seen this in your own referrer pages.
# I have banned it by referrer.
RewriteCond %{HTTP_REFERER} iaea\.org[NC]
RewriteRule .* - [F]

# NameProtect peddles their “online brand monitoring” to unsuspecting and gullible companies
# looking for people to sue. Despite the claims on their robot information page, they do not
# respect robots.txt; in fact, they spoof their User-Agent in multiple ways to avoid detection.
# I have banned them by User-Agent and IP address.
RewriteCond %{REMOTE_ADDR} ^12\.148\.196\.(12[8-9]¦1[3-9][0-9]¦2[0-4][0-9]¦25[0-5])$ [OR]
RewriteCond %{REMOTE_ADDR} ^12\.148\.209\.(19[2-9]¦2[0-4][0-9]¦25[0-5])$ [OR]
RewriteCond %{HTTP_USER_AGENT} NPBot[NC]
RewriteRule .* - [F]

# this ruleset is for unwanted useragents... possibly email harvesters

RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR] 
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Custo [OR] 
RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR] 
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR] 
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR] 
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR] 
RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR] 
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR] 
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR] 
RewriteCond %{HTTP_USER_AGENT} ^HMView [OR] 
RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR] 
RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR] 
RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR] 
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR] 
RewriteCond %{HTTP_USER_AGENT} ^larbin [OR] 
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR] 
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR] 
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR] 
RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR] 
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR] 
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR] 
RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR] 
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR] 
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Zeus 
RewriteRule ^.* - [F,L]
RewriteCond %{HTTP_USER_AGENT} ^[A-Z]+$[NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.Browse\s[NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.Eval[NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.Surf [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Harvest [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*HTTrack [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*libwww-perl [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*LWP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*prospector[NC,OR]
RewriteCond %{HTTP_USER_AGENT} AsiaNetBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ASSORT [NC,OR]
RewriteCond %{HTTP_USER_AGENT} attache [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ATHENS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} autohttp [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bew [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BlackWidow [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Bot\ mailto:craftbot@yahoo.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Bullseye [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CherryPicker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ChinaClaw[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Crescent [NC,OR]
RewriteCond %{HTTP_USER_AGENT} curl [NC,OR]
RewriteCond %{HTTP_USER_AGENT} devsoft's\ http\ component [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Deweb[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Digimarc [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Digger [NC,OR]
RewriteCond %{HTTP_USER_AGENT} digout4uagent[NC,OR]
RewriteCond %{HTTP_USER_AGENT} DIIbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DISCo[NC,OR]
RewriteCond %{HTTP_USER_AGENT} dloader(NaverRobot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Download\ Demon [NC,OR]
RewriteCond %{HTTP_USER_AGENT} eCatch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ecollector [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Educate\ Search [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EirGrabber [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EmailCollector [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EmailSiphon [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EmailWolf[NC,OR]
RewriteCond %{HTTP_USER_AGENT} EO\ Browse [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Express\ WebPictures[NC,OR]
RewriteCond %{HTTP_USER_AGENT} ExtractorPro [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EyeNetIE [NC,OR]
RewriteCond %{HTTP_USER_AGENT} fastlwspider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FEZhead[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Fetch[NC,OR]
RewriteCond %{HTTP_USER_AGENT} FlashGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Franklin\ Locator[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Full\ Web\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Getleft [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GetRight [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GetURL [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GetWebPage [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Go!Zilla [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Gozilla [NC,OR]
RewriteCond %{HTTP_USER_AGENT} go-ahead-got-it [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GrabNet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Grafula [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HMView [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HTML\ Works [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ia_archiver [NC,OR]
RewriteCond %{HTTP_USER_AGENT} IBM_Planetwide [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Image\ Stripper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Image\ Sucker[NC,OR]
RewriteCond %{HTTP_USER_AGENT} IncyWincy[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Industry\ Program[NC,OR]
RewriteCond %{HTTP_USER_AGENT} InterGET [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Internet\ Explore\ 5\.x [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Internet\ Ninja [NC,OR]
RewriteCond %{HTTP_USER_AGENT} InternetSeer.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Irvine [NC,OR]
RewriteCond %{HTTP_USER_AGENT} JetCar [NC,OR]
RewriteCond %{HTTP_USER_AGENT} JOC\ Web\ Spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} KWebGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} larbin [NC,OR]
RewriteCond %{HTTP_USER_AGENT} leech[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mass\ Downloader [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MCspider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Microsoft\ URL [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MIDown\ tool [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mirror [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Missauga\ Locator[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Missigua\ Locator[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mister\ PiX [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Monster [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mozilla.*NEWT[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mozilla\/3\.0\.\+Indy\ Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mozilla\/3.Mozilla\/2\.01 [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mozilla\/4\.0$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mozzilla [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MSIECrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Navroad [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NearSite [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NetAnts [NC,OR]
RewriteCond %{HTTP_USER_AGENT} netattache [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NetCarta [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NetSpider[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Net\ Vampire [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NetZIP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NICErsPRO[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Octopus [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Offline\ Explorer[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Offline\ Navigator [NC,OR]
RewriteCond %{HTTP_USER_AGENT} OpaL [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Openfind [NC,OR]
RewriteCond %{HTTP_USER_AGENT} OpenTextSiteCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} PackRat [NC,OR]
RewriteCond %{HTTP_USER_AGENT} PageGrabber [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Papa\ Foto [NC,OR]
RewriteCond %{HTTP_USER_AGENT} pavuk[NC,OR]
RewriteCond %{HTTP_USER_AGENT} pcBrowser[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Plucker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Production\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Program\ Shareware [NC,OR]
RewriteCond %{HTTP_USER_AGENT} PushSite [NC,OR]
RewriteCond %{HTTP_USER_AGENT} RealDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ReGet[NC,OR]
RewriteCond %{HTTP_USER_AGENT} RepoMonkey [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Rover[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Rsync[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Siphon [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ScoutAbout [NC,OR]
RewriteCond %{HTTP_USER_AGENT} searchterms\.it [NC,OR]
RewriteCond %{HTTP_USER_AGENT} semanticdiscovery[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Shai [NC,OR]
RewriteCond %{HTTP_USER_AGENT} sitecheck[NC,OR]
RewriteCond %{HTTP_USER_AGENT} SiteSnagger [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SmartDownload[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Spegla [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SpiderBot[NC,OR]
RewriteCond %{HTTP_USER_AGENT} SuperBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SuperHTTP[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Surfbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SurfWalker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} tAkeOut [NC,OR]
RewriteCond %{HTTP_USER_AGENT} tarspider[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Teleport\ Pro[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Telesoft [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Templeton[NC,OR]
RewriteCond %{HTTP_USER_AGENT} UtilMind [NC,OR]
RewriteCond %{HTTP_USER_AGENT} VoidEYE [NC,OR]
RewriteCond %{HTTP_USER_AGENT} w3mir[NC,OR]
RewriteCond %{HTTP_USER_AGENT} web.by.mail [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebBandit[NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebCopier[NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebCopy [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebEMailExtrac [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Web\ Image\ Collector[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Web\ Sucker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebAuto [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebCopier[NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebFetch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebMiner [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebReaper[NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebSauger[NC,OR]
RewriteCond %{HTTP_USER_AGENT} Website\ eXtractor [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Website\ Quester [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebSnake [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebStripper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} webvac [NC,OR]
RewriteCond %{HTTP_USER_AGENT} webwalk [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebWhacker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebZIP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} wget [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WhosTalking [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Widow[NC,OR]
RewriteCond %{HTTP_USER_AGENT} WUMPUS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} www\.pl [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Xaldon\ WebSpider[NC,OR]
RewriteCond %{HTTP_USER_AGENT} XGET [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Yandex [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Zeus.*Webster[NC]
#RewriteCond %{HTTP_USER_AGENT} test[NC]
RewriteCond %{REQUEST_URI}!^/badUA\.html [NC]
RewriteRule .* /badUA.html [L,E=HTTP_USER_AGENT:BAD_USER_AGENT]
RewriteCond %{HTTP_REFERER} ^-?$
RewriteCond %{HTTP_USER_AGENT} ^-?$
RewriteRule .* /cgi-bin/noagent.cmd [L,T=application/x-httpd-cgi]

charles99

2:08 pm on Aug 2, 2010 (gmt 0)

10+ Year Member



JD

How would I setup a broken link like you pointed out to JMonroe?

We create a file and place only this in it: ~
place teh file in our root and add this comment to our htaccess file:

# make these guys go away by making 404 handling look "broken"
# (internally rewrite the request to a very small file and return a 200-OK status)
RewriteRule nosui?chfile|thisfile(must|does)notexist (a-one-byte-file\.txt) [NC,L]


We are still trying to get the hang of writing the codes and need to know if we wrote this commment right? Or can we use this?

RewriteRule nosuichfile\.php$ - [F]

charles99

2:10 pm on Aug 2, 2010 (gmt 0)

10+ Year Member



And what name should we name this file?

jdMorgan

2:21 pm on Aug 2, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If you use the "- [F]" rule, then the user-agents making those requests will get a 403-Forbidden response and they will 'keep trying' to find hackable files. The whole point is to give them a 200-OK response so that they think, "Well, on this site, we can't tell good URLs from bad" and they will just go away.

If you serve a 403 response, they will just keep trying to find hackable files that don't return a 403 response.

This is based on my observations of their recent behaviour. You can 403 them or fool them with a 200-OK -- That's your choice. I find that they go away and don't waste my bandwidth if I fool them by serving a short file with a 200-OK.

You name the short file whatever you want to name it, as long as it is consistent with the filepath that you provide in the RewriteRule.

See the documents cited in our Apache Forum Charter. There is great risk modifying your server configuration (which is what this code is doing) if you do not fully understand what you are doing. One typo or a tiny logic error can ruin your search engine ranking overnight, and if not fixed, can put you out of business. Studying the documentation is time very well spent...

Jim

charles99

6:27 pm on Aug 17, 2010 (gmt 0)

10+ Year Member



jdMorgan I would like to know if the text is correct. I am still getting the hang of writing the text...

# make these guys go away by making 404 handling look "broken"
# (internally rewrite the request to a very small file and return a 200-OK status)
RewriteRule nosui?chfile|thisfile(must|does)notexist [mysite.com...] [NC,L]
or
RewriteRule nosui?chfile|thisfile(must|does)notexist [mysite.com...] [NC,L]


#Hackers request to phpMyadmin, plus mysql how would I combine the two or all three?

RewriteRule ^/phpMyAdmin.*$ /index.php

RewriteRule ^/mysql.*$ /index.php

RewriteRule ^/pma.*$ /index.php


I am also trying to figure out if this is an good option to use
# Nice trick.. => 301-Redirect to themself...
#RewriteCond %{ENV:ban} ^1$
#RewriteCond %{HTTP_REFERER} ^(.*)$
#RewriteRule ^(.*)$ %1 [R=301,L]


Thanks

jdMorgan

2:39 pm on Aug 18, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



1) 
 RewriteRule nosui?chfile|thisfile(must|does)notexist bit.txt [NC,L]
would be correct.

2) It would likely be a mistake to do anything with these requests except to 403 them: 
 RewriteRule phpMyAdmin|mysql|pma - [F]


3) Bad user agents almost never follow redirects. Either return a 403 as above or rewrite these requests to serve them your short "bit.txt" file. I strongly suggest the 403 option except for the "nosuchfile"-type of requests.

Jim
This 35 message thread spans 2 pages: 35
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

  1. Home
  2. Forums Index
  3. Server Side / Apache Web Server 3:20 am May 2, 2026