joined:Aug 19, 2008
Google webmaster tools keeps complaining about a removed directory from my website, webserver and webmaster tools.
I know that I need to specify a Disallow in robots.txt if I want a map no longer to appear in the search results by removing it through webmaster tools. Yet, this has not been done by google properly for 6 months already.
Google started complaining about "pages blocked by robots.txt", which is is a normal entry in the robots.txt for maps or pages that I no longer want to appear in google's search results.
After a few months, just to find out what would happen, I removed this disallow entry and guess what?
Right, google started to complain about the html pages held in the map that i requested to remove, not to be found.
What goes wrong here?
Best regards. I like this site.