Forum Moderators: open
Does it mean that a PR4 page will only be spidered in the monthly crawl and a PR7 will be spidered in a daily 'fresh-crawl', for example? If so, will the fresh crawl still spider links to find new pages?
Tx
BB
Above a very good thread on getting the Fresh spider to crawl your site.
There is 2 main things for getting the "fresh" spider to return and crawl your site, and that is.
High PageRank (inbound links from high quality sites)
And ever changing content.
If you have both of those you will probably say hallo to Googlebot every day.
And from what i know you can't know if you will get a Fresh crawl from looking at the Toolbar (even though it may help if you have a PageRank above 5 in the toolbar)