How can I stop those guys accesing my site <snip>.I don't want any link exchange ,why those guys hit my servers every day.
[edited by: engine at 8:15 am (utc) on May 17, 2006] [edit reason] TOS [/edit]
Stefan
3:02 am on May 17, 2006 (gmt 0)
When you see scrapers and other parasites vacuuming the site, you can deny them by IP range (although it's usually too late by the time you see them in the logs). You can also deny by referer in Apache, if they come with that (the worst of them don't). So, there's ways of keeping them out. However, you have to tolerate some degree of useless bot hits, unless you want to spend hours every day combatting them. There's all the logspammers, and Nutch people, and Bob's-your-uncle's new SE (that will never be used by anyone)... if you get bogged down in fighting them 24/7, you'll never have time to get any new pages online :-)