Should Google sitemap include robots.txt - Google Search and SEO forum at WebmasterWorld - WebmasterWorld

Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Should Google sitemap include robots.txt

Storyman

3:15 pm on Mar 28, 2006 (gmt 0)

10+ Year Member

Is adding robots.txt to Google's xml sitemap good, bad, or indifferent?

Phil_Payne

8:14 pm on Mar 28, 2006 (gmt 0)

10+ Year Member

> Is adding robots.txt to Google's xml sitemap good, bad, or indifferent?

Pointless. The sitemaps documentation states quite definitely that sitemaps don't fundamentally affect the crawling process.