joined:Jan 10, 2005
We have a bunch of 404 errors from Webmaster Tools that sit in a directory that has thousands of other valid URLs.
We want to disallow these 404 URLs without affecting the others in the directory like so:
404 error URL: /xyz/keyword/abc/
Valid URL: /xyz/keyword 1/abc/
If I disallow using:
will it disallow the URL above and continue to crawl all other URLs in the /xyz/ or will it try to disallow all of them?
Thanks in advance for your help.