joined:Dec 4, 2009
On one of our sites we recently had a big spike in soft 404 pages. All of these pages are "search" pages. example would be mysite.com/search/page9 All search pages are noindex follow currently and this is setup with the yoast plugin. My question here is would it be best to ad the below to robots txt
to prevent these pages from being crawled......really just want to know the safest way of getting rid of these showing up in my webmaster tools.