Forum Moderators: phranque

Message Too Old, No Replies

how to stop unwanted bots

some guys are spying

         

1984bb

11:07 pm on May 16, 2006 (gmt 0)

10+ Year Member



How can I stop those guys accesing my site
<snip>.I don't want any link exchange ,why those guys hit my servers every day.

[edited by: engine at 8:15 am (utc) on May 17, 2006]
[edit reason] TOS [/edit]

Stefan

3:02 am on May 17, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



When you see scrapers and other parasites vacuuming the site, you can deny them by IP range (although it's usually too late by the time you see them in the logs). You can also deny by referer in Apache, if they come with that (the worst of them don't). So, there's ways of keeping them out. However, you have to tolerate some degree of useless bot hits, unless you want to spend hours every day combatting them. There's all the logspammers, and Nutch people, and Bob's-your-uncle's new SE (that will never be used by anyone)... if you get bogged down in fighting them 24/7, you'll never have time to get any new pages online :-)