Forum Moderators: Robert Charlton & goodroi
I used the robots.txt validator in sitemaps, and it confirms these pages are blocked, and yet they are still being indexed... to add insult to injury, now many of my other pages are going supplimental..
is this some known issue, or am I doing something wrong?!
after my initial panic at seeing SUPPLIMENTAL all over my site, as well as thousands of pages that were supposed to be blocked by ROBOTS.TXT, i remembered something..
Last week while searching for some.. ehm.."pictures", i changed my G search preferences to "all languages" (dont want to miss out any any good Italian or Greek pics!).. So just now I changed my preference back to English only, and now when i do a SITE:mysite, everything looks fine... i switch back to "all languages" in preferences, and the thousands of pages that are supposed to be blocked, as well as the "supplemental" are back.. switch back to English only, and everything is fine once again..
Is this somehow by design? does this happen to anyone else?