Crawling frequency

Forum Moderators: DixonJones

Message Too Old, No Replies

Crawling frequency

kostis

4:15 pm on Nov 10, 2006 (gmt 0)

How often is a PR3 page crawled by Google / Yahoo / MSN

cabowabo

4:54 pm on Nov 10, 2006 (gmt 0)

How often is a PR3 page crawled by Google / Yahoo / MSN

Surface crawls 1-2 times per week. Deep crawl every 5-8 weeks.

Yahoo and MSN come when they hit it - deep crawls are never consistent, and they don't care about Google's PR scale.

Cabo

Matt Probert

5:31 pm on Nov 10, 2006 (gmt 0)

Our site is crawled daily by various spiders including Google and Yahoo. Google crawls about 1000 pages a day across the domain.

Matt

ronburk

2:14 am on Nov 11, 2006 (gmt 0)

Can't tell anymore, since I use AdSense and MediaBot shares a cache with Googlebot. I really miss being able to run a log report to tell me when a page was first "picked up" by Google.

kichus

11:33 am on Nov 13, 2006 (gmt 0)

If you want to track the Googlebot, it's easy now...

your Google webmaster central tool (google sitemap) can give you extended reports on GoogleBot crawling...

[crawl reports google sitemap] search in google....