I did the mistake that I got a bunch of people into Signal which is obviously already really good, but just a couple of month later I switched to Matrix and can't get anyone to move other than my fiance and my dad.
Anyway, the Signal <-> Matrix bridge is quite solid.
But in short, yes, but that is only a problem if you don't host your own bridge, because you're in control of the whole chain and everything from the bridge to your client is still encrypted.