I believe (micro)SD cards actually do have a controller. It's also possible to "Trim" SD cards via MMC commands, though this requires them to be accessible directly (i.e. /dev/mmcblk on Linux).
If you need USB-based storage that should be performant and reliable, there is a no-brainer solution: NVMe enclosure with a medium to high tier SSD. It's really hard to match the speed, reliability, and price of this solution.