It's amazing how crappy the internet has gotten over the last decade or so. Yes, before that was the blogspam and link hijackers, but those were real problems that search engines were actively cracking down on via their Spam teams.
In the meantime, the relevance teams took a break and started trusting their social signals too much - now we've built an internet which incentivizes popularity over accuracy and has done so for a long time. Used to be that I could find things on Google and, if I couldn't, I knew the advanced search tools to tailor the search and get where I needed. Now, I just add "site:reddit.com" to the query. But if the niche communities die, that's a lot of knowledge that just vanishes.