Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Googlebot crawl request dropped a lot after core algorithm update

         

azurewhite

3:22 am on Jun 22, 2021 (gmt 0)



Just before June core algorithm update, the Googlebot crawl request dropped a lot starting from May 30 and 31, just before the June core algorithm update.
Before the drop, the request normally is around 500,000 per day, but after the drop it only has 20,000 per day and it last around 20 days.
Does anyone know what's wrong with it or anyone has similar problem?

aristotle

7:23 pm on Jun 23, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Did the update affect your google rankings and traffic?

azurewhite

4:11 am on Jun 25, 2021 (gmt 0)



Yes, it affected, but not too much. My organic traffic decreased by 5%

aristotle

1:55 pm on Jun 25, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Well the crawl rate for a page is mainly determined by:

-- How much traffic the page gets
-- How often the content of the page typically changes
-- How many other pages are on the same site -- the more total pages, the less often a particular page is generally crawled.

Also note that there is more than one googlebot: desktop, mobile, image, etc.

So from what you've said, it's not clear to me why your site's crawl rate would take a big drop, or if it was related to an update.

In any case, your main concern should be your site's google rankings and traffic, not the crawl rate.