Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Include "noindex,follow" pages in a Google xml sitemap?

         

nippi

2:53 am on Jan 22, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have a client with a large site where navigation to inner pages works as follows.

Home >
then Alphabetical browse structure for all categories as follows
Category + home location page >
Category + child location page

eg Home location Page(eg London City yellow Pages) > Accommodation London City > Accommodation + Suburb of London
Client has set up a robots meta tag rule that when applied, results in a no index, follow robots meta tag being applied when the accommodation London city page is opened.... if there is in fact no accommodation in “London City”.... but there is accommodation in the child suburbs of London.

Without debating the rightness of this or the logic behind it, my question is is it appropriate to

1.Include no index, follow pages in an xml sitemap.
2.Only include pages that my client wishes to be incldued in the index

tedster

7:03 pm on Jan 22, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Note that googlebot must spider a page to see the meta tag - so you still want these noindex urls spidered so that the "follow" gets noticed for the links on the page.

Since an xml sitemap is only a "suggestion" to Google of urls they might spider, this is not a make or break decision. If there are links to these urls on the other pages of the site, then Google will spider them anyway. If there are no links to these urls on the domain, then the noindex part of the robots meta tag would probably drop the urls from Google's webmap for PR circulation.

It's most likely a non-issue.