Forum Moderators: open
Will they disappear in time?
If not, does it make sense to fight them, or is it better to use the 404 page to convert them to true visits?
If it make sense to fight them, how? Da boss said something about robots.txt. Since I'm not a webmaster, but rather an SEO neophyte who must work through a (willing, thank God) webmaster, the thought of tinkering with robots.txt makes me shake in fear...
Look forward to your thoughts.
Eris D Five Twenty-Three
I would favour the custom 404 page approach. This tells Google to ditch the page at the update following the crawl, but should also help people to find relevant content in your site.