Forum Moderators: goodroi
/widgets
will Google also not crawl files in a directory called
/widgets-two
and assume that a directory with anything following just /widget is excluded by default as well, even though the directory with the whole phrase isn't intended to be excluded?
/widgets was crawled when put up, and does show PR. Then I moved the contents to /widgets-two and Google will not touch what's in /widgets-two - all those pages are URL-only and I assume if it was a problem with the pages themselves they'd more likely just crawl them and slap them into the Supplemental index.
I think I may have done myself in by doing just that very thing, with a directory on a site.