Forum Moderators: phranque
I'm trying to block this web site that is a scraper site that is causing me duplicate content problems with google
below is a copy of my .htaccess file
however it is not blocking as it should, or maybe I have done something wrong.
# -FrontPage-
IndexIgnore .htaccess */.?* *~ *# */HEADER* */README* */_vti*
order allow,deny
deny from 66.***27.21
deny from workfr***dly.net
deny from www.workfr***dly.net
deny from 66.***.0.0 - 66.***.31.255
allow from all
<Limit GET POST>
order deny,allow
deny from all
allow from all
</Limit>
<Limit PUT DELETE>
order deny,allow
deny from all
</Limit>
AuthName example.com
AuthUserFile /var/www/vhosts/example.com/httpdocs/_vti_pvt/service.pwd
AuthGroupFile /var/www/vhosts/example.com/httpdocs/_vti_pvt/service.grp
[edited by: jdMorgan at 1:20 am (utc) on Feb. 9, 2008]
[edit reason] No specifics, please. Use example.com. [/edit]
should be changed to the following:
deny from 66.226.27.
Leave the trailing period in place.
REMOVE the following completely(it's invalid)
deny from 66.***.0.0 - 66.***.31.255
Another will need to advise you of the validity of the other lines.
[edited by: jdMorgan at 1:21 am (utc) on Feb. 9, 2008]
[edit reason] Obscured specifics [/edit]
this web site www.workfr***dly.net creates these urls that get indexed by google..
for example:
workfr***dly.net/browse/Office2003Blue/http/www.example.com//
( I just dont want a link on here with that [example.com] url [pointing to my site] )
So my goal is to block this site from accessing our site.
current .htaccess file is:
# -FrontPage-
IndexIgnore .htaccess */.?* *~ *# */HEADER* */README* */_vti*
order allow,deny
deny from 66.226.27.
allow from all
<Limit GET POST>
order deny,allow
deny from all
allow from all
</Limit>
<Limit PUT DELETE>
order deny,allow
deny from all
</Limit>
AuthName example.com
AuthUserFile /var/www/vhosts/example.com/httpdocs/_vti_pvt/service.pwd
AuthGroupFile /var/www/vhosts/example.com/httpdocs/_vti_pvt/service.grp
[edited by: jdMorgan at 1:24 am (utc) on Feb. 9, 2008]
[edit reason] example.com [/edit]
I use mod and Rewrites in a very KISS fashion.
Your required to contain the denies within the limit tags.
<Limit GET POST>
order allow,deny
deny from 66.226.27.
allow from all
</Limit>
As an aside; the forum requires you to obscure domain names and use example.com or expanded differences in your inquiries.
For your other problem, I'm assuming your interest is in referring links?
<Limit GET POST>
SetEnvIf Referer ^http\://www\.workfr***dly\.com keep_out
order allow,deny
deny from 66.226.27.
allow from all
deny from env=keep_out
</Limit>
Have no clue how all this will effect those other many lines in your htaccess.
[edited by: jdMorgan at 1:25 am (utc) on Feb. 9, 2008]
[edit reason] standardized example URLs in this thread [/edit]