How can I block image/site download

[zeus]

Hello - How can I block those software that downloads whole sites or downloads images all at once.
There must be some kind of script or .htaccess

[Alcoholico]

The way I do it, I don't know if there's a better way, most likely there is; A list of software to block by their User Agent. The list alone is useless since most of these leechers allow UA masking. Then, in my PHP scripts, I always include a small function to allow X requests every Y seconds, if the behaviour is not human-like then it refuses the request, I also take into account not to block necessary robots like googlebot. The UA list can also be used in httpd.conf or .htaccess files, but, as I said before, it may be useless if the UA is masked.
There was an interesting thread about leechers protection and badly behaved bots (2004 but still...) [webmasterworld.com...]

[zeus]

sounds interesting thats maybe the way to do it, but maybe you are right that something new can be done, lets see what others have to say.

[zeus]

could this be a option

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:[e-mail] [OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]
RewriteCond %{HTTP_USER_AGENT} ^Custo [OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
RewriteCond %{HTTP_USER_AGENT} ^HTTrack [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^Indy\ Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR]
RewriteCond %{HTTP_USER_AGENT} ^larbin [OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]
RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR]
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus
RewriteRule ^.* - [F,L]

[Alcoholico]

Hello.
Yes, that list includes some of the software in my own list (and others I did not know about), that's what I meant when I mentioned putting the list in httpd.conf or htaccess, however, keep in mind the list alone can be useless since some of these software have the ability to mask their UA but it makes a good first check.

If you want to go on with the list alone, I decided to enhance my list with your posted data and have combined both lists, yours and mine in httpd.conf or .htacces format:

RewriteEngine On 
RewriteCond %{HTTP_USER_AGENT} ^Alligator [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^autoemailspider [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Bot mailto:[e-mail] [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Custo [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^DA [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^DISCo [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^DISCo Pump [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^DnloadMage [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Download Demon [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Download Express [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Download Wonder [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^DreamPassport [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^DSurf [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^DTS Agent [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^EBrowse [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^eCatch [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Email Extractor [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^ESurf [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Express WebPictures [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^FileHeap! file downloader [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^FileHound [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Franklin Locator [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^FreshDownload [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^FrontPage [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^FSurf [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Gamespy_Arcade [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^GetBot [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^GetRight [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Grafula [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^HLoader [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^HMView [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^HTTrack [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^iGetter [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Image Stripper [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Image Sucker [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Industry Program [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Indy Library [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^InstallShield DigitalWizard [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^InterGET [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Internet Ninja [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^IUPUI Research Bot [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^JetCar [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^JoBo [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^JOC Web Spider [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Kapere [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Larbin [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^LeechGet [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^LightningDownload [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mac Finder [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mail Sweeper [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mass Downloader [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^MetaProducts Download Express [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Microsoft URL Control [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^MIDown tool [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Missauga Locate [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Missauga Locator [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Missouri College Browse [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mister PiX [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^MovableType [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mozi! [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mozilla/2.0 (compatible; MSIE 3.02; ) [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mozilla/3.0 (compatible) [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^MS FrontPage [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^MSIE_6.0 [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^MSProxy/2.0 [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^MyGetRight [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Navroad [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^NearSite [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Net Vampire [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^NEWT ActiveX [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Nitro Downloader [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Nutch [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Octopus [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Offline Explorer [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Offline Navigator [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^PagmIEDownload [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Papa Foto [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^pavuk [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Program Shareware [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Progressive Download [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^puf [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^PuxaRapido [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Python-urllib [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^ReGet [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^RepoMonkey Bait & Tackle [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^SpeedDownload [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^SQ Webscanner [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Stamina [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Star Downloader [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Teleport [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Teleport Pro [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^UdmSearch [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^URLGetFile [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^UtilMind HTTPGet [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Web Image Collector [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Web Sucker [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^webbandit [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebCapture [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^webcollage [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebGo IS [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Website eXtractor [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Website Quester [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WEP Search 00 [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Wget [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Widow [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Wildsoft Surfer [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Xaldon WebSpider [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^ZBot [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Zeus [NC,OR]
RewriteRule ^.* - [F,L]

[zeus]

great I will use your extended version, thanks

[zeus]

hmm tried your version and got a 500 error

[Alcoholico]

Sorry, looks like I forgot to escape, try this:

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Alligator [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^autoemailspider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto\:craftbot@yahoo\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Custo [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DA [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo\ Pump [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DnloadMage [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Express [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Wonder [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DreamPassport [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DSurf [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DTS\ Agent [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EBrowse [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Email\ Extractor [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ESurf [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^FileHeap\!\ file\ downloader [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^FileHound [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Franklin\ Locator [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^FreshDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^FrontPage [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^FSurf [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Gamespy_Arcade [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^GetBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^GetWeb\! [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Go\!Zilla [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Go\-Ahead\-Got\-It [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^HLoader [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^HTTrack [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^iGetter [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Industry\ Program [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Indy\ Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InstallShield\ DigitalWizard [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^IUPUI\ Research\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JoBo [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Kapere [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Larbin [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^LightningDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mac\ Finder [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mail\ Sweeper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MetaProducts\ Download\ Express [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Microsoft\ URL\ Control [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Missauga\ Locate [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Missauga\ Locator [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Missouri\ College\ Browse [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MovableType [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mozi\! [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mozilla\/2\.0\ \(compatible;\ MSIE\ 3\.02;\ \) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mozilla\/3\.0\ \(compatible\) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MS\ FrontPage [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MSIE_6\.0 [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MSProxy\/2\.0 [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MyGetRight [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NEWT\ ActiveX [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Nitro\ Downloader [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Nutch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Octopus [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^PagmIEDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^pavuk [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Program\ Shareware [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Progressive\ Download [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^puf [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^PuxaRapido [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Python\-urllib [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^RepoMonkey\ Bait\ &\ Tackle [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SpeedDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SQ\ Webscanner [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Stamina [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Star\ Downloader [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^UdmSearch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^URLGetFile [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^UtilMind\ HTTPGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^webbandit [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCapture [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^webcollage [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WEP\ Search\ 00 [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Wildsoft\ Surfer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ZBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus [NC,OR]
RewriteRule ^.* - [F,L]