Seems to only happen when User Default Sort Type is set to Top in the Sort Type settings. Changing it to New or Old fixed it for me.

Edit: or make sure you also set a User Default Sort Time if you're going to be using Top.