homepage Welcome to WebmasterWorld Guest from 54.145.209.80
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
How to stop my site from getting downloaded
mikep

10+ Year Member



 
Msg#: 2171 posted 11:31 am on Mar 26, 2004 (gmt 0)

First they tried HTTrack and got a 403.

4.3.7.13 - - [25/Mar/2004:14:31:43 -0500] "GET / HTTP/1.1" 403 210 "-" "Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)"

Then they tried MSIECrawler and got a 403.

4.3.7.13 - - [25/Mar/2004:14:35:10 -0500] "GET / HTTP/1.1" 403 210 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler)"

Then they used this:

4.3.7.13 - - [25/Mar/2004:14:39:51 -0500] "GET / HTTP/1.1" 200 8495 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Win32)"

They downloaded about 60 megabytes of my site.

The IP Address is out of Hawaii. No website is hosted with it.

Is there a way I can stop this from happening?

 

pmkpmk

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 2171 posted 12:38 pm on Mar 26, 2004 (gmt 0)

There are ways - and I followed them to some extent. However, in the end I found it's a race I could not win, so I gave up.

But if you want to try, here's the best place to start: [webmasterworld.com ]

mikep

10+ Year Member



 
Msg#: 2171 posted 12:54 pm on Mar 26, 2004 (gmt 0)

Thanks pmkpmk. I've read through that post a few times and came up with my own "close to perfect .htaccess ban list".

I can buy more bandwidth and I wouldn't mind for just the 60 megabytes/day. But what keeps someone from doing this over and over again? That would amount to more bandwidth than I would want to pay for. And I sure don't want to ban every ISP in the state of Hawaii.

pmkpmk

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 2171 posted 3:00 pm on Mar 26, 2004 (gmt 0)

Is it always the same IP? Have you tried looking up the administrative contact with "whois" and simply tried to ask WHY he/she's doing it? If the IP address in your sample is valid, then it's a Verizon DSL account. Drop an email to abuse@verizon.net and see what they say...

mikep

10+ Year Member



 
Msg#: 2171 posted 3:11 pm on Mar 26, 2004 (gmt 0)

Nah, that's just the one in my logs from yesterday. Everyday its somebody else. If the same person kept doing it I would contact their ISP.

bull

10+ Year Member



 
Msg#: 2171 posted 3:29 pm on Mar 26, 2004 (gmt 0)

do a site search on WebmasterWorld for 'bot trap'

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved