Forum Moderators: open

Message Too Old, No Replies

Bot list

HTTrack or httrack

         

wilderness

2:45 pm on Nov 12, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



24.112.231.95 - - [11/Nov/2004:22:07:57 -0800] "HEAD /myfolder/mysubfolder
HTTP/1.1" 301 0 "anothersite"
"Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)"

There are multiple mentions of this UA in the archives.
All however are in the lower case name rather than the newer mixed case name.

BTW the 301 was a result of the missing forward slash for the second folder.

ncw164x

10:06 pm on Nov 13, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



HTTrack is a hard one to ban because you can change the user agent to whatever you want, I ripped my own site using my own name as a user agent

adding this to the apache httpd.config will not work and I have not tried .htaccess yet but have seen reference to it within other threads that it can be stopped using the .htaccess file