Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Thousands of Spambot IPs Hitting my Site


incrediBILL - 12:50 am on Dec 13, 2011 (gmt 0)


Perhaps: grep "GET /attacked_page.php" ?


You're right, that's safer!

I just hammered out that line on my way out the door, forgive me ;)

Do you ref to spiritualseo problem, or are you generally speaking?


I use that approach any time I need a quick list of IPs out of access_log

In this case, he has an immediate need to stop a group hitting a certain page, works like a charm. If they were crawling all over the site, wouldn't work so well.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4396669.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com