To be honest, there's a certain subset of women who love it when guys go full removed. If you are obsessed with cheese, and can talk about cheese with passion in a way to captivate any audience, then don't hide or downplay it. Literally talk about cheese like you're a 2am Youtuber and girls will love it.
Can confirm this, the amount of genuine attention I received while losing my mind talking about Warhammer 40k with dates is unbelievable!
Of course, you should probe a bit beforehand. I got lucky and my dates were pretty much all into fantasy stuff, so 40k wasn't a huge leap, but there was no interest expressed in 40k other than specifically to hear me talk about it.