... screenreaders often offer a function to read out just a list of links on the page rather than the whole page text. This provides a useful shortcut for users trying to navigate through the site quickly.
So what you describe would defeat the purpose of the above functionality. It only affects screenreaders, but you did ask about accessibility. :)