Better control over Bluetooth connections?

I'm running Calyx OS (which for my device is on Android 13 at the moment). I would like to have better control over which Bluetooth-connections my phones attempts to connect to when enabled and which it does not. Right now, it seems to try to connect to whatever it was connected to last, even though it is no where near me. I have to wait for the connection to fail before I can start another connection. This eats up about 10-15 seconds every time I want to connect to a Bluetooth-speaker if it wasn't that last device I connected to.

Is there any way of getting better control over this? Best case for me would be to define some devices it should always try to connect to and other devices that should require manual connection.