Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Thousands of Spambot IPs Hitting my Site


spiritualseo - 5:25 pm on Dec 12, 2011 (gmt 0)


One thing I noticed is that this bot is requesting only one page on my site. Would it be possible to apply the 'block referrer' rule to this one page alone? This page is located inside a sub-folder.

Will something like this work, provided that I want to apply this rule to the page:

http://www.example.com/foldername/page.php

<IfModule mod_rewrite.c>
#Options +FollowSymlinks
RewriteEngine On
RewriteBase /
RewriteEngine on
RewriteCond %{HTTP_REFERER} ^$
RewriteRule ^foldername/page\.php$ - [F]
</IfModule>


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4396669.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com