Access Denied (403) and 508 errors

[free_flower]

Hello, I have encountered the issue of

Access Denied (403)

on multiple indexed pages of my website, which has now been resolved.

However, the technician mentioned that my website is experiencing a high volume of webbot scans, leading to excessive resource consumption and resulting in warnings like 5xx or 4xx errors. Is this because the website map is being updated too frequently?

Also, there have been 508 errors in the past few days. Should I consider halting Google indexing-related operations?

[tangor]

Are you doing any kind of bot control (deny) on your site?

403 is a proper response to banned bots and should not have any adverse issues.

How did you resolve this?

[phranque]

i would begin by analyzing the 4xx and 5xx errors in your web server access log file.

[not2easy]

Where are you finding these errors? Are these log errors or errors shown in GSC? Have you determined what or who you are blocking? You should try to determine the cause of the errors. Any 403 errors should be intentional, and if possible, offer a workaround for possible accidental errors. See whether your access controls are too broad or not properly functioning. As phranque says, analyze your log files and find out what is the cause and the effect. Then you can determine what to do about it (if anything).

[free_flower]

The "403" error is because the technician accidentally disabled it, and the technician has solved it (he deleted a certain command line)

But the "508" problem occurred when I opened my own website: the website could not be loaded, and then displayed 508, but it recovered itself not long after. The technician said this was because my website was scanned by a large number of webbot, causing excessive resource consumption.

So now I don't dare to try to update the site map and other operations.

[phranque]

The technician said this was because my website was scanned by a large number of webbot, causing excessive resource consumption.

i would ask for evidence of this assertion or look for it yourself in your web server access log file.

[not2easy]

If you are unable to visit your site, I would guess that others have problems as well, including the bots you want to be visiting. I agree with phranque, you should take a look at your server's access logs.