- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Googlebot not respecting custom crawl rate
g1smd - 2:23 am on Jun 18, 2011 (gmt 0)
Yes, www and non-www are separate sites as far as WMT is concerned. The incoming external links and crawl rate reports are interesting for each.
You should not be directly serving content on both of them, you need a domain canonicalisation redirect from non-www to www.
Thread source: http://www.webmasterworld.com/robots_txt/4325733.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com