Should I take the disc out if I'm not using it?

I have just a single physical copy of a game, and I've just been leaving the disc in the console; but after seeing a few videos about older consoles and noticing the console slows down while the disc is being read I'm curious if there is danger to the disc, or the console or even if I could get a bit of a performance gain by removing it when not playing that specific game.