Fun fact about cd, over half of the data present on a common cd is used for error correction and because of that it's still readable normally even in case of it having several sections significantly damaged.

I think it's simply a matter of physical limitations, we basically reached the physical limit of how hard disk work storing while ssd relie on microchips and we are becoming capable of making more and more circuitry in the same amount of silicon which makes it cheaper