ok I got I wierd IP and I think it's a scraper

scraper wierd ip

[mojomike]

the IP that visited me is 133.27.228.132.

it pulled my entire my site.

any news?

Mike

[stapel]

The IP belongs to the Japan Network Information Center (JNIC). I can't find much info, but most of what I can find suggests suspicious behavior, in general.

What was the user-agent? Did it respect your robots.txt file? How quickly were your files pulled? (Ten pages requested every second, or two pages every minutes, or something else?)

Thank you.

Eliz.

[The Contractor]

Very simple. If your site/content isn't aimed towards other countries, block the whole IP range via .htaccess. For instance if it is a "shopping" site that ships only to the USA, why have visitors from Asian countries visiting? Most site rippers come from the Asian countries in my experience and the RIPE network is getting worse all the time.

[edited by: The_Contractor at 5:45 pm (utc) on Nov. 26, 2006]

[gregbo]

Before blocking an entire IP range of a country, consider very carefully the implications of that decision. Geotargeting is not reliable, so there may very well be people in the countries you wish to provide access to who would be denied due to these blocks. Also, you may have customers who are travelers.

[mojomike]

what's interesting about this ip is that it respected the robot.txt file. but at the same time when i went to the ip's site it pulled up a validation of html ( or css i forgot ).

so it was weird.

also I am in the rental business ( apartments ) so I can not block country ip's otherwise I could loose some business.

Mike