Forum Moderators: Robert Charlton & goodroi
Is there anything I can possibly do in my robots or .htaccess file to stop these spam referrers
Generally, the three options for such links are:
- Block them with robots exclusion
- Redirect them where they're supposed to go
- Let them return a 404
I can't see any good reason to robots exclude them. If they are malformed requests for obviously non-existent URLs, I would let them generate a 404 error. If it's clear from the request what page they were intended for, 301 redirect them to that page. E.g. www.example.com/category/pag could redirect to www.example.com/category/page