joined:Sept 26, 2012
How does crawl budget work? I believe the only factor impacting crawl budget is PageRank. Also how does Google allocate it? Say, Googlebot will crawl x no. of pages, or x no. of pages but also page size and response time impacts it, or let me crawl as many pages for x no. of hours. How does it work?