To get rid of Shorts without any extensions, this tip works for the mobile app, I presume it works for Web too.
Click on the 3 dots by a Short and select "Not interested" or similar. Repeat this until every Short in the section is gone. Now the whole section disappears and stays this way. It hasn't come back yet for me since I did this a few weeks ago.