Forum Moderators: Robert Charlton & goodroi
The sites with:
User-agent: *
Disallow: /print/
Are not as well indexed as sites that have plain old:
User-agent: *
Disallow:
Does anyone think that Google is beginning to take robots.txt rules more seriously and this is an effect of this?
Has anyone else noticed similar results?
It does make me want to remove all excludes.