I used YouTube Revanced which is exactly what you described.

Not sure if there are any reasons not to be using it that I've missed but it's works great for me and included a bunch of YouTube premium and customisation features (like hiding shorts).