joined:Jan 10, 2005
We currently have a situation where we have many hundreds of thousands of URLs that we need to get rid of as we believe they have damaged our rankings.
Because of the scale and complexity of the problem, its not possible to list each URL in the WMT URL removal tool as it would take months to input.
We are currently investigating the use of the "directory" removal option. Let me give you a quick scenario:
e.g. we have 1000 URLs like so:
www.domain.com/a/keyword/b/123/ - set to meta NOINDEX
www.domain.com/a/keyword/b/456/ - set to meta NOINDEX
We want to be able to remove the directory at the top level, and by doing so, we must disallow in robots.txt as follows:
The main question is, will Google remove the whole directory, or will it only remove the pages that have a meta NOINDEX set to it?
Has anyone had any experience on how to remove hundreds of thousands of URLs that are inside a directory where many URLs need protecting from a removal - would it be easier to just remove the whole lot and start from scratch? Are there ranking issues based on full removal of good URLs when they are reindexed? How quick will it come back to the good URLs to get rank back?
Really appreciate your help.