It's like, sometimes, if I really focus on a memory then I can start to fill in 3D space and contrasts of light/dark and especially faces. I can't visualize color or really texture, but everything else comes to me. It takes a lot of focus and doesn't come naturally though!
I still mostly don't visualize stuff, but sometimes a vision will strike me out-of-the-blue when I'm reminded of it. Weird.
I have a similar story, but I attribute it to Vyvanse and external hormones. I couldn't visualize anything, meaningfully or not throughout my twenties, but gained the ability again ( had it as a kid ) later on.