robotsdobetter - 5:40 pm on Aug 22, 2007 (gmt 0) That is good news, but can't say I have seen them reduce the crawling load on any of my web sites. Maybe after a week or so I'll see better results.
That is good news, but can't say I have seen them reduce the crawling load on any of my web sites. Maybe after a week or so I'll see better results.
Page is a not externally linkable