Forum Moderators: Robert Charlton & goodroi
Does not work.
The subdirectory gives back 404
Is included in robots.txt
AND the 404 page has a <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> in it.
There is no such directory any more.
Argh denied denied denied. Since over a week. The gbot is daily on my site. It's the same site as in the webmaster Central console. The site diagnosis shows some of the pages as 404 and excluded in robots.txt