While it is annoying to people like you and me, this is a good thing for the average user. Your average downloads folder probably contains sensitive information that shouldn't be visible to apps. Same with Android/data. Locking it down is annoying for sure, but it's admittedly a good privacy&security measure.
Even if it's blocked for the average user, it'd still be awesome if we could circumvent it with adb. I've used KDE Connect to access my phone remotely for a long time, and now that feature is useless.
I have often found malware apps with all sorts of permission on my relatives phones which suddenly started to lag alot. These folders can be easily exploited by malware apps, so its kinda good.