Forum Moderators: Robert Charlton & goodroi
Now problem im facing is that in one site i have removed rule for those pages which were removed in sept but still google is showing this in webmaster tools
ý Not found ý(1,849)ý
while in other site in which still rule is added in robot file it is showing this
URLs restricted by robots.txt ý(1428)
I have two question
first is should i add robot rule for both sites or remove that rule for both sites and 2nd question is how can i get rid of this complelety as removed urls have no back links but still showing in google Webmaster tools.
is blocking thousand of urls using robots can be a problem or not (to loss traffic from google).
The only way blocking content with robots exclusion is likely to cause a drop in traffic is if you exclude pages that appear in search results and attract visitors - if you're removing undesirable pages then there should be no negative effect.