Forum Moderators: open
[edited by: volatilegx at 12:52 am (utc) on Oct. 6, 2006]
[edit reason] obfuscated ip address [/edit]
found this:
222.11.239.** - - [04/Oct/2006:15:55:32 +0000] "GET /robots.txt HTTP/1.0" 200 6767 "-" "RSS_READER (mctwist@mail.dr-k.info)"
it eats all of my traffic.
How do i identify and block this spider? any body?
As far as identification?
The best you may do is sift through what you find on a google search until you find something of worth.
There are multiple ways to block (deny access) and th options are dependent upon your own requirements.
1) You could deny the entire 222 Class A.
2) You could deny the entire range of the provider
222.0.0.0 - 222.15.255.255
3) you could deny the Class D range (hoping they will not
visit from another range that the provider has)
a) "222.11.239.".
3) You may deny on a little used name in the user agent
a) "RSS-Reader"
b) "mctwist"
4) You may also deny on the UA or a portion of when it comes
from a specific IP or IP range (see 1-3 above).
