For most games, including ones on Steam this is what I do.
Being up program launcher with key combination.
Start typing name of game, hit enter.
Then if Steam is not open Steam launches,.
Game launches.
Get yourself a launcher program. Having to bring up Steam and search a library of dozens of games seems maddening when you could just type a few letters.
By launcher I mean something like Spotlight on Mac OS. The Windows Start menu probably has some of this functionality, at least for launching applications and can be brought up with a key, there are probably alternatives as well. I'm on Linux and use Rofi for this.
I don't mean a large program necessary for launching games, I mean a very lightweight program that can launch your games, or any other app, and more.