Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Automatically detect crawlers / bots


Globetrotter - 6:41 pm on Jan 2, 2012 (gmt 0)


I'm using the script now for a while but I had to disable the slow scraper detection because it blocked visitors. But now also other users are complaining about the fastscraper part.

Any idea how to tweak the settings so I can still block bots. And what is a good way to validate if its really a user or a bot?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4395123.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com