So true I'm afraid.
Me being in a niche of a niche in the top level niche the scale of links in my world is a LOT lower than the other 99% here.
A gargantuan 20+ year old site in my niche has about 200 backlinks. The mid-weights are typically 25-75 backlinks.
The rest puff along on the fumes of a few mentions of their domain name in text (unlinked) to 2-15 backlinks for those who seek them actively.
So, for the last case those 2 more links matters a lot :-)