Welcome to WebmasterWorld Guest from 220.127.116.11
Traditionally I have used robots.txt
But would it be better to redirect(*) such a request to the true url? I am thinking this could see an abusive competitor actually optomising the site for you. To stop all this nonsense I believe you may have to turn there attacks into your defence. By 301 such request a potential Canonical attack could actually benefit a site. That I am sure would destroy these attacks..........
I am must emphasise I am not talking about Xss attacks just attempts to cause a Canonical.
Your thoughts totally appreciated
*rewrite changed to redirect after g1smd pointed out error.
[edited by: Bilbo at 2:00 am (utc) on Dec. 9, 2008]
My wording was incorrect it should 301 redirect to the correct url and show that in the header. I have ammended post to show change thanks for highlighting the error.
[edited by: Bilbo at 2:02 am (utc) on Dec. 9, 2008]
Again, any unique page on your site should be reachable using one and only one URL -- Anything else is a duplicate-content problem if not 301-redirected or rejected with a 404 or 410 error response.
For the purposes of this subject, no variation of any kind should be tolerated -- down to an exact character-by-character URL comparison level. You are looking for an *exact* match of absolutely everything showing in the browser address bar, and anything else needs handling.