Google has almost stopped crawling our domains

[prica]

Google has almost stopped crawling on numerous of our domains as of February 5th. We have already turned everything upside down and are not blocking Google IPs or user agents anywhere. Not in the robots.txt, not in the WAF or other firewalls. We also do not see any slow Google bot requests in our logs.

[ibb.co]

We can access our domains manually normally via the Google Search Console. The same applies to the Google Schema Testing Tool.

So far we have not seen any changes in the ranking. There are no manual measures or security problems listed in our GSC accounts either.

All other search engines are crawling us normally.

Has anyone else had the same problem since the beginning of February?

[not2easy]

How are your sites doing as far as basics like CWV? It looks like the average response time isn't optimal.

[prica]

How are your sites doing as far as basics like CWV? It looks like the average response time isn't optimal.

mostly green.

The high response time cannot be measured anywhere else as Google reports it in the GSC. Not in our logs and not in the firewall logs. Our data center was also unable to measure or reproduce it anywhere.

[not2easy]

You might find insight in rustybrick's link, in that case. It looks like a Google change that is not something your actions can influence but it helps to learn more about it.

[Dirk_Knight]

I have the same problem on the same dates. I also noticed that a large chunk of our crawl budget has now shifted to our CDN subdomain, where we had a massive spike in user agent Googlebot-image. Due to Google updating their IPs and our root domain potentially blocked by our CDN on the 4th, Googlebot couldn’t access our main site and then re-prioritised crawl budget allocation towards assets that was immediately accessible. Be interesting if anyone has also seen this happen.

[tangor]

Not surprised... g and its ai component and and and and ... all those things take time and effort and so slices of time are adjusted here and there for all that other to get done...

OR the mighty g is running out of resources and things are getting hit and miss.

OR Data centers are updating at increasingly long times between.

OR the sky is falling and Chicken Little was right...

However, Bing seems to be working just fine, so go figure!

[Michau]

Is the issue still occurring? Have the affected services recently blocked any resources for Googlebot? For example, those related to coupons: [seroundtable.com...]
Do you see any connection with Site Reputation Abuse?

[prica]

Yes, the problem is still there. We haven't blocked anything for Google. We have nothing to do with coupons. And only crawling is affected - rankings are still good.

[rf1789]

We're still experiencing the same issue on our site. Has anyone seen a recovery?

[prica]

Since yesterday, Google's bot visits have been rising sharply again. Can anyone else observe this?

[rf1789]

I saw an uptick in crawl requests through google search console as of this morning. seems like it may have been a google error that they have fixed

[Dirk_Knight]

Also confirming I have seen an improvement on crawl requests since the 4th of March.

[Michau]

Yes, I also see increase requests. But anyone saw problem with traffic on discover in the same time and still has?

[Dirk_Knight]

Is anyone experiencing this issue again with a large decrease in crawls requests ? Our site crawl limit started to come back on March 3rd and it’s been stable for several weeks. However, on March 21st we seen a large decrease again.