Forum Moderators: open

Message Too Old, No Replies

v92 .nat.svl.searchme.com spider.?

taking bandwith?

         

jim_knopf

6:10 pm on Jun 10, 2008 (gmt 0)

10+ Year Member



Hi all,

wannabe "webmaster" or "weekend warrior" here again with a question.

I inquired before on that here this visitor / or spider is basically hanging out at our server so to say. v92 .nat.svl.searchme.com Tempe / Arizona - 208.111.154.92 is what it shows at the stats. We got a total of 70 websites on server, all very small ( 5 - 40 pages individual domains) and all only Baja Sur related tourism biz or tour guides etc.

It's getting like to much with that thing, is there 10 -15 times a day at every domain.

I have root access, How could I lock that thing out for good?
I'm not real good at that and had some questions before at the Apache forum / .htacces yet for all domains it seem to be better doing it global?

My server is with Linux Suse 10.2 with Plesk

Any advise or help? Thanks in advance.

Greetings from La Paz - MEX

keyplyr

7:46 pm on Jun 10, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



On Apache server mod_rewrite banning the user-agent may be used in your .htaccess file:


RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^v92
RewriteRule .* - [F]

jim_knopf

8:15 pm on Jun 10, 2008 (gmt 0)

10+ Year Member



I kinda understand that but would that not be per doamin?

I would have to put a .htaccess file in each domain directory root folder for that, correct?

I like to ban that thing complete server wide for all domains if that option exists.

So of the domains have Wordpress on with generated .htaccess files from that software and I would not know on a individual base how to add that then without interfering with existing code.... :(

Thanks for reply anyway.

wilderness

8:57 pm on Jun 10, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The very first serp that I previously provided a link to provides that the crawling is being done by more ranges than the "v92":
[webmasterworld.com...]

In the event that you desire server wide denial?
You'll need to explore "http.conf"

You'll need more data lines however the single line in "SetEnvIf" is:

deny from 208.111.128.0/18

this line denied access foe limelight users in the following ranges:
208.111.128.0 - 208.111.191.255

edited by wilderness:

This search provides (3rd serp)
[google.com...]
info on the "v92.nat.svl.searchme.com"

superclown2

10:19 pm on Jun 10, 2008 (gmt 0)



Do you have iptables? It should be in /etc/sysconfig or something like that. Just add

-A INPUT -s 208.111.154.92 -j DROP

If you're not sure just where to put it in the file best show us your existing file first, you could lock yourself out of the server if you put it in the wrong place.

jim_knopf

10:19 am on Jun 16, 2008 (gmt 0)

10+ Year Member



Hello Wildernezz + Superclown,

sorry for late reply. As said, this is not my "real" job and so often away from any computer for 1-2 weeks out in the boonies..... :-)
Wilder: I been reading thru all the links a while back already when I addressed the topic the first time. That's why I tought about the global/server wide ban.

Superclown, I will look and copy it of server. Should I post that here or send?

Greetings from an very hot La Paz @ the Baja.

jim_knopf

7:21 pm on Jun 19, 2008 (gmt 0)

10+ Year Member



Just a update in that thing: I went to [webmasterworld.com...] and did my homework try to be a friendly guy and wrote them people a e-mail to exclude me etc. No change, seem even increased spidering. I'll hit over to the apache board to present my .htaccess and maybe get help to ad the correct code to it. I appericate your thoughts Superclown but I changed my mind and do the 68 account folder by folder.