Msg#: 23621 posted 4:44 am on Apr 27, 2004 (gmt 0)
Starting a new thread on this one...I am trying to figure out what it takes to get a daily deep crawl like some sites I have seen. I am thinking that you need a PR of over 5 maybe even 6. Does anyone have a site that gets a daily deep crawl and if so what is your site's PR? Thanks.
Msg#: 23621 posted 9:15 am on Apr 28, 2004 (gmt 0)
yeah we have moved up to PR6 and our site (1000 pages) is heavily spidered most days. When we were PR 5 we had a daily visit but nothing amazing. I reckon there's a correlation here. We got a link from a really good PR8 site and since then googlebot has been a lot more hungrier and come looking much more.
Msg#: 23621 posted 11:52 am on Apr 28, 2004 (gmt 0)
My sites have almost daily deep crawl. I think the reason must be daily updates on the sites. Also there is this site where updates aren't much but yes we do agressive bloging for the site. Bot remains there almost everyday. East, West, North OR South, Wherever spider is visiting you should have your link there. Spider will come to you.